Nov 02 10:39:02 devstack cinder-volume[75724]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:39:02 devstack cinder-volume[75724]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:39:02 devstack cinder-volume[75724]: we strongly recommend against using it for new projects. Nov 02 10:39:02 devstack cinder-volume[75724]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:39:02 devstack cinder-volume[75724]: framework. For more detail see Nov 02 10:39:02 devstack cinder-volume[75724]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:39:02 devstack cinder-volume[75724]: import eventlet # noqa Nov 02 10:39:05 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:39:05 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:39:05 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:39:06 devstack cinder-volume[75724]: INFO dbcounter [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Registered counter for database cinder Nov 02 10:39:06 devstack cinder-volume[75724]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:39:06 devstack cinder-volume[75724]: DEBUG dbcounter [-] [75724] Writer thread running {{(pid=75724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:39:06 devstack cinder-volume[75724]: INFO cinder.rpc [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:39:06 devstack cinder-volume[75724]: INFO cinder.rpc [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:39:06 devstack cinder-volume[75724]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:39:07 devstack cinder-volume[75724]: INFO cinder.volume.manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Determined volume DB was empty at startup. Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG cinder.volume.manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75724) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:39:07 devstack cinder-volume[75724]: INFO cinder.volume.manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:39:07 devstack cinder-volume[75724]: WARNING stevedore.named [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:39:07 devstack cinder-volume[75724]: WARNING castellan.key_manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:39:07 devstack cinder-volume[75724]: WARNING cinder.keymgr.conf_key_mgr [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG cinder.volume.drivers.lvm [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75724) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_concurrency.processutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_concurrency.processutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=75724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:39:07 devstack cinder-volume[75724]: INFO cinder.rpc [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 10:39:07 devstack cinder-volume[75724]: INFO cinder.rpc [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 10:39:07 devstack cinder-volume[75724]: WARNING stevedore.named [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:39:07 devstack cinder-volume[75724]: WARNING castellan.key_manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:39:07 devstack cinder-volume[75724]: INFO cinder.volume.manager [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:39:07 devstack cinder-volume[75724]: INFO oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Starting 1 workers Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Started child 75879 {{(pid=75724) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Full set of CONF: {{(pid=75724) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] ******************************************************************************** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Configuration options gathered from: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:39:07 devstack cinder-volume[75879]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] ================================================================================ {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] allow_availability_zone_fallback = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] allow_compression_on_image_upload = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] allowed_direct_url_schemes = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] api_rate_limit = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] auth_strategy = keystone {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] az_cache_duration = 3600 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_availability_zone = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_host = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_stats_polling_interval = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backup_api_class = cinder.backup.api.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backup_name_template = backup-%s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backup_use_same_host = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backup_use_temp_snapshot = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] chap_password = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] chap_username = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_internal_tenant_project_id = 75d774c2fc1f4a3c994aed9a96cfb9d9 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_internal_tenant_user_id = 587c6a9ccfc64bd485a90ca9c62dd6a1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cloned_volume_same_az = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cluster = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] compression_format = gzip {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] compute_api_class = cinder.compute.nova.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] config_dir = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] config_source = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] control_exchange = openstack {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] debug = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] default_availability_zone = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] default_group_type = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] default_volume_type = lvmdriver-1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] disk_geometry = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_client_cert = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_client_cert_key = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_data_namespace = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_ssl_cert_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_ssl_cert_verify = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] driver_use_ssl = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] enable_force_upload = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] enable_new_services = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] enable_unsupported_driver = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] enforce_multipath_for_image_xfer = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] filter_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_api_insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_api_ssl_compression = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_ca_certificates_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_catalog_info = image:glance:publicURL {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_num_retries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance_request_timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] goodness_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] graceful_shutdown_timeout = 5 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] group_api_class = cinder.group.api.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] host = devstack {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_compress_on_upload = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_conversion_address_space_limit = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_conversion_cpu_limit = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_conversion_disable = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_upload_use_cinder_backend = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_upload_use_internal_tenant = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_volume_cache_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_volume_cache_max_count = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] image_volume_cache_max_size_gb = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] init_host_max_objects_retrieval = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] instance_format = [instance: %(uuid)s] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iscsi_target_flags = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iscsi_write_cache = on {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iser_helper = tgtadm {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iser_ip_address = 192.168.122.252 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iser_port = 3260 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_color = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_config_append = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_dir = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_options = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_rotate_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_rotate_interval_type = days {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] log_rotation_type = none {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] max_age = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] max_logfile_count = 30 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] max_logfile_size_mb = 200 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] max_over_subscription_ratio = 20.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] message_reap_interval = 86400 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] message_ttl = 2592000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] migration_create_volume_timeout_secs = 300 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] monkey_patch = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] monkey_patch_modules = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] my_ip = 192.168.122.252 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] no_snapshot_gb_quota = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] num_iser_scan_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] num_shell_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] num_volume_device_scan_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] nvmeof_conn_info_version = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] nvmet_ns_id = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] nvmet_port_id = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_max_limit = 1000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_ext_list = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_listen_port = 8776 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_use_ssl = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] osapi_volume_workers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] per_volume_size_limit = -1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] periodic_fuzzy_delay = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] periodic_interval = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] public_endpoint = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] publish_errors = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_backup_gigabytes = 1000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_backups = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_gigabytes = 1000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_groups = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_snapshots = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] quota_volumes = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] rate_limit_burst = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] rate_limit_except_level = CRITICAL {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] rate_limit_interval = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] reinit_driver_count = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] replication_device = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] report_discard_supported = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] report_interval = 120 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] reservation_clean_interval = 86400 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] reservation_expire = 86400 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] reserved_image_namespaces = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] reserved_percentage = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] rpc_response_timeout = 120 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] run_external_periodic_tasks = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] scst_target_driver = iscsi {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] scst_target_iqn_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_down_time = 720 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] shell_completion = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] snapshot_name_template = snapshot-%s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] snapshot_same_host = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] split_loggers = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] state_path = /opt/stack/data/cinder {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] storage_availability_zone = nova {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] storage_protocol = iSCSI {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] syslog_log_facility = LOG_USER {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_helper = lioadm {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_ip_address = 192.168.122.252 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_port = 3260 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_protocol = iscsi {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] target_secondary_ip_addresses = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] trace_flags = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] transport_url = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] until_refresh = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_chap_auth = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_default_quota_class = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_journal = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_json = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_multipath_for_image_xfer = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_stderr = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] use_syslog = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] verify_glance_signatures = enabled {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_api_class = cinder.volume.api.API {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_backend_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_clear = zero {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_clear_ionice = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_clear_size = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_copy_bps_limit = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_dd_blocksize = 1M {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_name_template = volume-%s {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_service_inithost_offload = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volume_usage_audit_period = month {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] zoning_mode = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_concurrency.disable_process_locking = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.auth_section = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.auth_type = password {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.auth_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.cache = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.include_service_catalog = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.interface = public {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_password = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcache_username = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.region_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.service_type = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.backend = dogpile.cache.null {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.backend_argument = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.backend_expiration_time = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.config_prefix = cache.oslo {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.debug_cache_backend = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.enable_retry_client = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.enable_socket_keepalive = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.expiration_time = 600 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.hashclient_retry_attempts = 2 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_dead_retry = 300 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_pool_maxsize = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_sasl_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.password = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.proxies = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.redis_db = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.redis_server = localhost:6379 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.retry_attempts = 2 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.retry_delay = 0.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.socket_keepalive_count = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.socket_keepalive_idle = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.socket_keepalive_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.socket_timeout = 1.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.tls_allowed_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.tls_cafile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.tls_certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.tls_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.tls_keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cache.username = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] coordination.backend_url = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.asyncio_connection = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.asyncio_slave_connection = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.backend = sqlalchemy {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.connection = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.connection_debug = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.connection_parameters = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.connection_recycle_time = 3600 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.connection_trace = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.db_inc_retry_interval = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.db_max_retries = 20 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.db_max_retry_interval = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.db_retry_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.max_overflow = 50 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.max_pool_size = 5 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.max_retries = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.mysql_wsrep_sync_wait = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.pool_timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.retry_interval = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.slave_connection = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.sqlite_synchronous = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.synchronous_reader = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] database.use_db_reconnect = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_tracing.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.connection_string = messaging:// {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.es_doc_type = notification {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.es_scroll_size = 10000 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.es_scroll_time = 2m {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.filter_error_trace = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.hmac_keys = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.sentinel_service_name = mymaster {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.socket_timeout = 0.1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.trace_requests = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler.trace_sqlalchemy = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler_jaeger.process_tags = {} {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler_jaeger.service_name_prefix = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] profiler_otlp.service_name_prefix = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.enforce_new_defaults = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.policy_default_rule = default {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.policy_file = policy.yaml {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.group = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.helper_command = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] privsep_osbrick.user = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.group = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.helper_command = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] cinder_sys_admin.user = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.auth_section = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.auth_type = password {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.cafile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.collect_timing = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.send_service_user_token = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.split_loggers = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.tls_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] service_user.tls_min_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.auth_section = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.auth_type = password {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.collect_timing = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.region_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.split_loggers = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.tls_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] glance.tls_min_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.backend_availability_zone = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.chap_password = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.chap_username = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.disk_geometry = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_client_cert = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_client_cert_key = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_data_namespace = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.driver_use_ssl = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.extra_capabilities = {} {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.filter_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.goodness_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iscsi_target_flags = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iscsi_write_cache = on {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iser_helper = tgtadm {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iser_port = 3260 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.lvm_share_target = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.lvm_type = auto {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.num_shell_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.replication_device = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.report_discard_supported = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.reserved_percentage = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_helper = tgtadm {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_port = 3260 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_protocol = iscsi {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.trace_flags = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.unique_fqdn_network = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.use_chap_auth = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_backend_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_clear = zero {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_clear_ionice = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_clear_size = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_reports.file_event_handler = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_reports.log_dir = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.backend_host = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.chap_password = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.chap_username = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.disk_geometry = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_client_cert = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.extra_capabilities = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.filter_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack sudo[75883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.goodness_function = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iser_helper = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iser_ip_address = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iser_port = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:07 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.lvm_share_target = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.lvm_type = auto {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.num_shell_tries = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.replication_device = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.report_discard_supported = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.reserved_percentage = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.scst_target_driver = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.storage_protocol = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_helper = lioadm {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_ip_address = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_port = 3260 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.trace_flags = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.use_chap_auth = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_clear = zero {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_clear_size = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] lvmdriver-1.volumes_dir = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_notifications.driver = [] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_notifications.retry = -1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] key_manager.fixed_key = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.barbican_api_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.barbican_endpoint = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.barbican_endpoint_type = public {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.barbican_region_name = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.cafile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.collect_timing = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.number_of_retries = 60 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.retry_delay = 1 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.send_service_user_token = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.split_loggers = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.tls_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.tls_min_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.verify_ssl = True {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican.verify_ssl_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.auth_section = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.auth_type = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.cafile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.certfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.collect_timing = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.insecure = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.keyfile = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.split_loggers = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.timeout = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.tls_ciphers = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] barbican_service_user.tls_min_version = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.approle_role_id = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.approle_secret_id = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.auth_method = approle {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.auth_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.kv_mountpoint = secret {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.kv_path = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.kv_version = 2 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.namespace = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.root_token_id = **** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.ssl_ca_crt_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.timeout = 60.0 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.token_file = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.token_role = None {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.use_ssl = False {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:39:08 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] ******************************************************************************** {{(pid=75724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:39:08 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.394s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:08 devstack sudo[75888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:08 devstack sudo[75888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:08 devstack sudo[75888]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.305s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:39:08 devstack cinder-volume[75879]: INFO cinder.brick.local_dev.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:08 devstack sudo[75896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:08 devstack sudo[75896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:08 devstack sudo[75896]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG cinder.brick.local_dev.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75879) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 10:39:08 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:08 devstack sudo[75999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:08 devstack sudo[75999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:09 devstack sudo[75999]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.546s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:09 devstack sudo[76208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:09 devstack sudo[76208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:09 devstack sudo[76208]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:09 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:09 devstack sudo[76311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 10:39:09 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:10 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.280s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:10 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:10 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:10 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:10 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:10 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:10 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:10 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:10 devstack sudo[76505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:10 devstack sudo[76505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:11 devstack sudo[76505]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:11 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:11 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:11 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:11 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:11 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:11 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.383s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:11 devstack cinder-volume[75879]: INFO cinder.volume.drivers.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:11 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:11 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:11 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:12 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:12 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:12 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:12 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:12 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:12 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:12 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:12 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:12 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:12 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:12 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:12 devstack sudo[76701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:12 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:13 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:13 devstack cinder-volume[75879]: INFO cinder.volume.driver [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG cinder.volume.driver [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75879) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_db.sqlalchemy.engines [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75879) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writer thread running {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG cinder.db.api [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Building query based on filter {{(pid=75879) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG cinder.image.image_utils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75879) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 02 10:39:13 devstack cinder-volume[75879]: INFO cinder.keymgr.migration [None req-6165b671-3c53-4b06-bc39-8d6b0b3c48b2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:13 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:13 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:13 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:13 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:13 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:13 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:13 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:13 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:13 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:14 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:14 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:14 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:14 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG cinder.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Notifying Schedulers of capabilities ... {{(pid=75879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:39:14 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Driver initialization completed successfully. Nov 02 10:39:14 devstack cinder-volume[75879]: INFO cinder.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Initiating service 2 cleanup Nov 02 10:39:14 devstack cinder-volume[75879]: INFO cinder.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Service 2 cleanup completed. Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG cinder.service [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Creating RPC server for service cinder-volume {{(pid=75879) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG cinder.service [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75879) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:39:14 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:14 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:39:14 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:14 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:14 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:14 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:14 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:15 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:15 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:15 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:15 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:39:15 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:15 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:15 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:15 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:39:15 devstack sudo[76734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:39:15 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:39:15 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root Nov 02 10:39:15 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:39:15 devstack cinder-volume[75879]: INFO cinder.volume.manager [None req-4cb5550a-54de-43f0-9502-3e2cce927f78 None None] Driver post RPC initialization completed successfully. Nov 02 10:39:17 devstack cinder-volume[75724]: DEBUG dbcounter [-] [75724] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:25 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:SELECT=4 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:25 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:39:42 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager._thread_info {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:39:42 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread count: 6 {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:39:42 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread info: [<_MainThread(MainThread, started 137923651096704)>, , , , , ] {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:40:42 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:42 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:40:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:42 devstack sudo[80535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:40:42 devstack sudo[80535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:42 devstack sudo[80535]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:42 devstack sudo[80688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:40:42 devstack sudo[80688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:43 devstack sudo[80688]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:43 devstack sudo[80824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:40:43 devstack sudo[80824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:43 devstack sudo[80824]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:40:43 devstack sudo[80980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:40:43 devstack sudo[80980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:40:43 devstack sudo[80980]: pam_unix(sudo:session): session closed for user root Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG cinder.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Notifying Schedulers of capabilities ... {{(pid=75879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager._thread_info {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread count: 6 {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:40:43 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread info: [<_MainThread(MainThread, started 137923651096704)>, , , , , ] {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:41:25 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:41:42 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:41:42 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:41:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:42 devstack sudo[83136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:41:42 devstack sudo[83136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:42 devstack sudo[83136]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:42 devstack sudo[83154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:41:42 devstack sudo[83154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:43 devstack sudo[83154]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:43 devstack sudo[83190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:41:43 devstack sudo[83190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:43 devstack sudo[83190]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:41:43 devstack sudo[83197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:41:43 devstack sudo[83197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:41:43 devstack sudo[83197]: pam_unix(sudo:session): session closed for user root Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG cinder.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Notifying Schedulers of capabilities ... {{(pid=75879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager._thread_info {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread count: 6 {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:41:43 devstack cinder-volume[75879]: DEBUG cinder.volume.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] thread info: [<_MainThread(MainThread, started 137923651096704)>, , , , , ] {{(pid=75879) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:42:42 devstack cinder-volume[75879]: DEBUG oslo_service.periodic_task [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75879) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:42:42 devstack cinder-volume[75879]: DEBUG cinder.volume.drivers.lvm [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Updating volume stats {{(pid=75879) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 10:42:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:42 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 10:42:42 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:42 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:42 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:42 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:42:42 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:43 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:43 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 10:42:43 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:43 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:42:43 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 10:42:43 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:42:43 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG oslo_concurrency.processutils [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75879) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:42:43 devstack cinder-volume[75879]: DEBUG cinder.manager [None req-cfa23a63-7d9e-4db7-8a76-2872a6933142 None None] Notifying Schedulers of capabilities ... {{(pid=75879) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:25 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:SELECT=1 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:43:25 devstack cinder-volume[75879]: DEBUG dbcounter [-] [75879] Writing DB stats cinder:UPDATE=1 {{(pid=75879) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:43:32 devstack cinder-volume[75724]: INFO oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Caught SIGTERM, stopping children Nov 02 10:43:32 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Acquiring lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:32 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Acquired lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:32 devstack cinder-volume[75724]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Releasing lock "singleton_lock" {{(pid=75724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:32 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Stop services. {{(pid=75724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:43:32 devstack cinder-volume[75724]: DEBUG oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Killing children. {{(pid=75724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:43:32 devstack cinder-volume[75724]: INFO oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Waiting on 1 children to exit Nov 02 10:43:34 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Acquiring lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:34 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Acquired lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:34 devstack cinder-volume[75879]: DEBUG oslo_concurrency.lockutils [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Releasing lock "singleton_lock" {{(pid=75879) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:34 devstack cinder-volume[75879]: WARNING amqp [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:43:34 devstack cinder-volume[75879]: WARNING amqp [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:43:34 devstack cinder-volume[75724]: INFO oslo_service.backend._eventlet.service [None req-a6b6b9a1-ad7a-41c8-893b-74f0323e738f None None] Child 75879 exited with status 0 Nov 02 10:43:34 devstack cinder-volume[85902]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:43:34 devstack cinder-volume[85902]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:43:34 devstack cinder-volume[85902]: we strongly recommend against using it for new projects. Nov 02 10:43:34 devstack cinder-volume[85902]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:43:34 devstack cinder-volume[85902]: framework. For more detail see Nov 02 10:43:34 devstack cinder-volume[85902]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:43:34 devstack cinder-volume[85902]: import eventlet # noqa Nov 02 10:43:36 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:36 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:36 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:37 devstack cinder-volume[85902]: INFO dbcounter [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Registered counter for database cinder Nov 02 10:43:37 devstack cinder-volume[85902]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:37 devstack cinder-volume[85902]: DEBUG dbcounter [-] [85902] Writer thread running {{(pid=85902) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:43:37 devstack cinder-volume[85902]: INFO cinder.rpc [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:43:37 devstack cinder-volume[85902]: INFO cinder.rpc [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:38 devstack cinder-volume[85902]: INFO cinder.volume.manager [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Determined volume DB was empty at startup. Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG cinder.volume.manager [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85902) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:43:38 devstack cinder-volume[85902]: INFO cinder.volume.manager [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 10:43:38 devstack cinder-volume[85902]: WARNING stevedore.named [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:43:38 devstack cinder-volume[85902]: WARNING castellan.key_manager [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:43:38 devstack cinder-volume[85902]: WARNING cinder.keymgr.conf_key_mgr [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:43:38 devstack cinder-volume[85902]: INFO cinder.volume.manager [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:38 devstack cinder-volume[85902]: INFO oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Starting 1 workers Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Started child 86119 {{(pid=85902) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Full set of CONF: {{(pid=85902) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] ******************************************************************************** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Configuration options gathered from: {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] ================================================================================ {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] allow_availability_zone_fallback = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] allow_compression_on_image_upload = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] allowed_direct_url_schemes = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] api_rate_limit = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] auth_strategy = keystone {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_availability_zone = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_host = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_stats_polling_interval = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backup_api_class = cinder.backup.api.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[86119]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backup_name_template = backup-%s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backup_use_same_host = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backup_use_temp_snapshot = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] chap_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] chap_username = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_internal_tenant_project_id = 75d774c2fc1f4a3c994aed9a96cfb9d9 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_internal_tenant_user_id = 587c6a9ccfc64bd485a90ca9c62dd6a1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cluster = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] compression_format = gzip {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] compute_api_class = cinder.compute.nova.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] config_dir = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] config_source = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] control_exchange = openstack {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] debug = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] default_availability_zone = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] default_group_type = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] default_volume_type = QuobyteHD {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] disk_geometry = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_client_cert = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_client_cert_key = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_data_namespace = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_ssl_cert_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_ssl_cert_verify = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] driver_use_ssl = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] enable_new_services = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] enable_unsupported_driver = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] enabled_backends = ['QuobyteHD'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] enforce_multipath_for_image_xfer = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] filter_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_api_insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_api_ssl_compression = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_ca_certificates_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_catalog_info = image:glance:publicURL {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_num_retries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance_request_timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] goodness_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] graceful_shutdown_timeout = 5 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] group_api_class = cinder.group.api.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] host = devstack {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_compress_on_upload = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_conversion_address_space_limit = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_conversion_cpu_limit = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_conversion_disable = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_upload_use_cinder_backend = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_upload_use_internal_tenant = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_volume_cache_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_volume_cache_max_count = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] image_volume_cache_max_size_gb = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] init_host_max_objects_retrieval = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] instance_format = [instance: %(uuid)s] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iscsi_target_flags = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iscsi_write_cache = on {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iser_helper = tgtadm {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iser_ip_address = 192.168.122.252 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iser_port = 3260 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_color = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_config_append = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_dir = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_options = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_rotate_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_rotate_interval_type = days {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] log_rotation_type = none {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] max_age = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] max_logfile_count = 30 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] max_logfile_size_mb = 200 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] max_over_subscription_ratio = 20.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] message_reap_interval = 86400 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] message_ttl = 2592000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] migration_create_volume_timeout_secs = 300 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] monkey_patch = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] monkey_patch_modules = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] my_ip = 192.168.122.252 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] no_snapshot_gb_quota = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] num_iser_scan_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] num_shell_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] num_volume_device_scan_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] nvmeof_conn_info_version = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] nvmet_ns_id = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] nvmet_port_id = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_max_limit = 1000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_ext_list = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_listen_port = 8776 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_use_ssl = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] osapi_volume_workers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] per_volume_size_limit = -1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] periodic_fuzzy_delay = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] periodic_interval = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] public_endpoint = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] publish_errors = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_backup_gigabytes = 1000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_backups = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_gigabytes = 1000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_groups = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_snapshots = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] quota_volumes = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] rate_limit_burst = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] rate_limit_except_level = CRITICAL {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] rate_limit_interval = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] reinit_driver_count = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] replication_device = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] report_discard_supported = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] report_interval = 120 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] reservation_clean_interval = 86400 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] reservation_expire = 86400 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] reserved_image_namespaces = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] reserved_percentage = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] rpc_response_timeout = 120 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] run_external_periodic_tasks = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] scst_target_driver = iscsi {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] scst_target_iqn_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_down_time = 720 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] shell_completion = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] snapshot_name_template = snapshot-%s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] split_loggers = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] state_path = /opt/stack/data/cinder {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] storage_availability_zone = nova {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] storage_protocol = iSCSI {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] syslog_log_facility = LOG_USER {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_helper = lioadm {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_ip_address = 192.168.122.252 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_port = 3260 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_protocol = iscsi {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] target_secondary_ip_addresses = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] trace_flags = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] transport_url = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] until_refresh = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_chap_auth = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_default_quota_class = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_journal = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_json = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_multipath_for_image_xfer = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_stderr = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] use_syslog = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] verify_glance_signatures = enabled {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_api_class = cinder.volume.api.API {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_backend_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_clear = zero {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_clear_ionice = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_clear_size = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_copy_bps_limit = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_dd_blocksize = 1M {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_name_template = volume-%s {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_service_inithost_offload = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volume_usage_audit_period = month {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] zoning_mode = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_concurrency.disable_process_locking = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.auth_section = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.auth_type = password {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.auth_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[86119]: INFO cinder.volume.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.cache = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.remotefs [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86119) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.include_service_catalog = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.interface = public {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcache_username = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.region_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.service_type = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.backend = dogpile.cache.null {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.backend_argument = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.backend_expiration_time = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.config_prefix = cache.oslo {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.debug_cache_backend = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.enable_retry_client = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.enable_socket_keepalive = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.expiration_time = 600 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.hashclient_retry_attempts = 2 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_dead_retry = 300 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_pool_maxsize = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_sasl_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.proxies = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.redis_db = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.redis_server = localhost:6379 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.retry_attempts = 2 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.retry_delay = 0.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.socket_keepalive_count = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.socket_keepalive_idle = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.socket_keepalive_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.socket_timeout = 1.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.tls_allowed_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.tls_cafile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.tls_certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.tls_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.tls_keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cache.username = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] coordination.backend_url = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.asyncio_connection = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.asyncio_slave_connection = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.backend = sqlalchemy {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.connection = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.connection_debug = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.connection_parameters = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.connection_recycle_time = 3600 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.connection_trace = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.db_inc_retry_interval = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.db_max_retries = 20 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.db_max_retry_interval = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.db_retry_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.max_overflow = 50 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.max_pool_size = 5 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.max_retries = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.mysql_wsrep_sync_wait = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.pool_timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.retry_interval = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.slave_connection = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.sqlite_synchronous = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.synchronous_reader = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] database.use_db_reconnect = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_tracing.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.connection_string = messaging:// {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.es_doc_type = notification {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.es_scroll_size = 10000 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.es_scroll_time = 2m {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.filter_error_trace = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.hmac_keys = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.sentinel_service_name = mymaster {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.socket_timeout = 0.1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.trace_requests = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler.trace_sqlalchemy = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler_jaeger.process_tags = {} {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler_jaeger.service_name_prefix = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] profiler_otlp.service_name_prefix = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.enforce_new_defaults = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.policy_default_rule = default {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.policy_file = policy.yaml {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_policy.remote_timeout = 60.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.group = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.helper_command = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] privsep_osbrick.user = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.group = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.helper_command = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] cinder_sys_admin.user = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.auth_section = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.auth_type = password {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.cafile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.collect_timing = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.send_service_user_token = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.split_loggers = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.tls_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] service_user.tls_min_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.auth_section = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.auth_type = password {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.collect_timing = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.region_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.split_loggers = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.tls_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] glance.tls_min_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.backend_availability_zone = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.chap_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.chap_username = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.disk_geometry = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_client_cert = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_client_cert_key = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_data_namespace = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.driver_use_ssl = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.extra_capabilities = {} {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.filter_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.goodness_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iscsi_target_flags = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iscsi_write_cache = on {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iser_helper = tgtadm {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iser_port = 3260 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_host = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_login = admin {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_mount_options = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_private_key = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_share_path = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_ssh_port = 22 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.num_shell_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.quobyte_volume_url = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.replication_device = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.report_discard_supported = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.reserved_percentage = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_helper = tgtadm {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_port = 3260 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_protocol = iscsi {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.trace_flags = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.unique_fqdn_network = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.use_chap_auth = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_backend_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_clear = zero {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_clear_ionice = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_clear_size = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_reports.file_event_handler = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_reports.log_dir = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.backend_availability_zone = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.backend_host = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.chap_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.chap_username = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.chiscsi_conf = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.disk_geometry = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_client_cert = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_data_namespace = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.driver_use_ssl = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.extra_capabilities = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.filter_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.goodness_function = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iscsi_target_flags = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iscsi_write_cache = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iser_helper = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iser_ip_address = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iser_port = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.iser_target_prefix = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_host = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_login = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_mount_options = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_password = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_private_key = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_share_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_ssh_port = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.num_shell_tries = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nvmet_ns_id = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.nvmet_port_id = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.replication_device = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.report_discard_supported = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.reserved_percentage = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.scst_target_driver = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.storage_protocol = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_helper = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_ip_address = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_port = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_prefix = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_protocol = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.trace_flags = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.unique_fqdn_network = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.use_chap_auth = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_clear = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_clear_ionice = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_clear_size = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] QuobyteHD.volumes_dir = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_notifications.driver = [] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_notifications.retry = -1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] key_manager.fixed_key = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.barbican_api_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.barbican_endpoint = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.barbican_endpoint_type = public {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.barbican_region_name = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.cafile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.collect_timing = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.number_of_retries = 60 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.retry_delay = 1 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.send_service_user_token = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.split_loggers = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.tls_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.tls_min_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.verify_ssl = True {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican.verify_ssl_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.auth_section = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.auth_type = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.cafile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.certfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.collect_timing = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.insecure = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.keyfile = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.split_loggers = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.timeout = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.tls_ciphers = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] barbican_service_user.tls_min_version = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.approle_role_id = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.approle_secret_id = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.auth_method = approle {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.auth_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.kv_mountpoint = secret {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.kv_path = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.kv_version = 2 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.namespace = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.root_token_id = **** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.ssl_ca_crt_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.timeout = 60.0 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.token_file = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.token_role = None {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.use_ssl = False {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:38 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] ******************************************************************************** {{(pid=85902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86119) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:43:38 devstack cinder-volume[86119]: WARNING cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:43:38 devstack cinder-volume[86119]: WARNING cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Running cmd (subprocess): mount.quobyte {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:38 devstack quobyte-client[86124]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:43:38 devstack quobyte-client[86124]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:38 devstack cinder-volume[86119]: INFO cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 ... Nov 02 10:43:38 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be -c /etc/quobyte/client-cinder.cfg {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:38 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be -c /etc/quobyte/client-cinder.cfg Nov 02 10:43:38 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:39 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.400s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 succeeded Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.411s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:39 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:39 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.296s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.volume.driver [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.driver [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8103370666504, 'free_capacity_gb': 1773.8103370666504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86119) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_db.sqlalchemy.engines [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG dbcounter [-] [86119] Writer thread running {{(pid=86119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.db.api [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Building query based on filter {{(pid=86119) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.image.image_utils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86119) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.keymgr.migration [None req-68777c95-9bb6-40f9-aa04-9015c5f54dc1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:39 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:39 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.236s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Notifying Schedulers of capabilities ... {{(pid=86119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.volume.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Driver initialization completed successfully. Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Initiating service 3 cleanup Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Service 3 cleanup completed. Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.service [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Creating RPC server for service cinder-volume {{(pid=86119) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.service [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86119) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:43:39 devstack cinder-volume[86119]: INFO cinder.volume.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:39 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:39 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:39 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:40 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:40 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.293s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:40 devstack cinder-volume[86119]: INFO cinder.volume.manager [None req-2353d459-f78e-4d35-9940-a7afa8ea0c47 None None] Driver post RPC initialization completed successfully. Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG cinder.volume.drivers.quobyte [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:44 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:44 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:44 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG oslo_concurrency.processutils [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.233s {{(pid=86119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:44 devstack cinder-volume[86119]: DEBUG cinder.manager [None req-c757f497-68d3-40e1-94a2-1106ef685f18 None None] Notifying Schedulers of capabilities ... {{(pid=86119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:45 devstack cinder-volume[85902]: INFO oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Caught SIGTERM, stopping children Nov 02 10:43:45 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Acquiring lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:45 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Acquired lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:45 devstack cinder-volume[85902]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Releasing lock "singleton_lock" {{(pid=85902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:45 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Stop services. {{(pid=85902) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 10:43:45 devstack cinder-volume[85902]: DEBUG oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Killing children. {{(pid=85902) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 10:43:45 devstack cinder-volume[85902]: INFO oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Waiting on 1 children to exit Nov 02 10:43:48 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Acquiring lock "singleton_lock" {{(pid=86119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:48 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Acquired lock "singleton_lock" {{(pid=86119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:48 devstack cinder-volume[86119]: DEBUG oslo_concurrency.lockutils [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Releasing lock "singleton_lock" {{(pid=86119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:48 devstack cinder-volume[86119]: WARNING amqp [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:43:48 devstack cinder-volume[86119]: WARNING amqp [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 10:43:48 devstack cinder-volume[85902]: INFO oslo_service.backend._eventlet.service [None req-fdf47e42-a280-4198-9c63-471b1c73a78e None None] Child 86119 exited with status 0 Nov 02 10:43:48 devstack cinder-volume[86469]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 10:43:48 devstack cinder-volume[86469]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:43:48 devstack cinder-volume[86469]: we strongly recommend against using it for new projects. Nov 02 10:43:48 devstack cinder-volume[86469]: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:43:48 devstack cinder-volume[86469]: framework. For more detail see Nov 02 10:43:48 devstack cinder-volume[86469]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:43:48 devstack cinder-volume[86469]: import eventlet # noqa Nov 02 10:43:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 10:43:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 10:43:51 devstack cinder-volume[86469]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86469) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 10:43:52 devstack cinder-volume[86469]: INFO dbcounter [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Registered counter for database cinder Nov 02 10:43:52 devstack cinder-volume[86469]: DEBUG oslo_db.sqlalchemy.engines [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG dbcounter [-] [86469] Writer thread running {{(pid=86469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:43:53 devstack cinder-volume[86469]: INFO cinder.rpc [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 10:43:53 devstack cinder-volume[86469]: INFO cinder.rpc [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_db.sqlalchemy.engines [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:53 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Determined volume DB was empty at startup. Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG cinder.volume.manager [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86469) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 10:43:53 devstack cinder-volume[86469]: WARNING stevedore.named [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 10:43:53 devstack cinder-volume[86469]: WARNING castellan.key_manager [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:43:53 devstack cinder-volume[86469]: WARNING cinder.keymgr.conf_key_mgr [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 10:43:53 devstack cinder-volume[86469]: INFO cinder.volume.manager [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_db.sqlalchemy.engines [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86469) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:53 devstack cinder-volume[86469]: INFO oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Starting 1 workers Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Started child 86783 {{(pid=86469) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Full set of CONF: {{(pid=86469) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] ******************************************************************************** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] Configuration options gathered from: {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] ================================================================================ {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] allow_availability_zone_fallback = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] allow_compression_on_image_upload = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] allowed_direct_url_schemes = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] api_rate_limit = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] auth_strategy = keystone {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_availability_zone = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_host = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_stats_polling_interval = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backup_api_class = cinder.backup.api.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backup_name_template = backup-%s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backup_use_same_host = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backup_use_temp_snapshot = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86783]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] chap_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] chap_username = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_internal_tenant_project_id = 75d774c2fc1f4a3c994aed9a96cfb9d9 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_internal_tenant_user_id = 587c6a9ccfc64bd485a90ca9c62dd6a1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cluster = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] compression_format = gzip {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] compute_api_class = cinder.compute.nova.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] config_dir = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] config_source = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] control_exchange = openstack {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] debug = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] default_availability_zone = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] default_group_type = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] default_volume_type = QuobyteHD {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] disk_geometry = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_client_cert = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_client_cert_key = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_data_namespace = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_ssl_cert_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_ssl_cert_verify = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] driver_use_ssl = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] enable_new_services = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] enable_unsupported_driver = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] enabled_backends = ['QuobyteHD'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] enforce_multipath_for_image_xfer = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] filter_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_api_insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_api_servers = ['http://192.168.122.252/image'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_api_ssl_compression = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_ca_certificates_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_catalog_info = image:glance:publicURL {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_num_retries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance_request_timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] goodness_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] graceful_shutdown_timeout = 5 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] group_api_class = cinder.group.api.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] host = devstack {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_compress_on_upload = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_conversion_address_space_limit = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_conversion_cpu_limit = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_conversion_disable = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_upload_use_cinder_backend = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_upload_use_internal_tenant = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_volume_cache_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_volume_cache_max_count = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] image_volume_cache_max_size_gb = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] init_host_max_objects_retrieval = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] instance_format = [instance: %(uuid)s] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iscsi_target_flags = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iscsi_write_cache = on {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iser_helper = tgtadm {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iser_ip_address = 192.168.122.252 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iser_port = 3260 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_color = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_config_append = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_dir = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_options = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_rotate_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_rotate_interval_type = days {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] log_rotation_type = none {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] max_age = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] max_logfile_count = 30 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] max_logfile_size_mb = 200 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] max_over_subscription_ratio = 20.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] message_reap_interval = 86400 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] message_ttl = 2592000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] migration_create_volume_timeout_secs = 300 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] monkey_patch = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] monkey_patch_modules = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] my_ip = 192.168.122.252 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] no_snapshot_gb_quota = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] num_iser_scan_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] num_shell_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] num_volume_device_scan_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] nvmeof_conn_info_version = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] nvmet_ns_id = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] nvmet_port_id = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_max_limit = 1000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_ext_list = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_listen_port = 8776 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_use_ssl = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] osapi_volume_workers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] per_volume_size_limit = -1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] periodic_fuzzy_delay = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] periodic_interval = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] public_endpoint = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] publish_errors = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_backup_gigabytes = 1000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_backups = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_gigabytes = 1000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_groups = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_snapshots = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] quota_volumes = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] rate_limit_burst = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] rate_limit_except_level = CRITICAL {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] rate_limit_interval = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] reinit_driver_count = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] replication_device = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] report_discard_supported = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] report_interval = 120 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] reservation_clean_interval = 86400 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] reservation_expire = 86400 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] reserved_image_namespaces = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] reserved_percentage = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] rpc_response_timeout = 120 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] run_external_periodic_tasks = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] scst_target_driver = iscsi {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] scst_target_iqn_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_down_time = 720 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] shell_completion = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] snapshot_name_template = snapshot-%s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] split_loggers = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] state_path = /opt/stack/data/cinder {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] storage_availability_zone = nova {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] storage_protocol = iSCSI {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] syslog_log_facility = LOG_USER {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_helper = lioadm {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_ip_address = 192.168.122.252 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_port = 3260 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_protocol = iscsi {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] target_secondary_ip_addresses = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] trace_flags = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] transport_url = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] until_refresh = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_chap_auth = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_default_quota_class = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_journal = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_json = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_multipath_for_image_xfer = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_stderr = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] use_syslog = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] verify_glance_signatures = enabled {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_api_class = cinder.volume.api.API {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_backend_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_clear = zero {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_clear_ionice = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_clear_size = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_copy_bps_limit = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_dd_blocksize = 1M {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_name_template = volume-%s {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_service_inithost_offload = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volume_usage_audit_period = month {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] zoning_mode = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_concurrency.disable_process_locking = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.auth_section = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.auth_type = password {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.auth_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.cache = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.include_service_catalog = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.interface = public {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcache_username = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.region_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.service_type = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.252/identity {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.backend = dogpile.cache.null {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.backend_argument = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.backend_expiration_time = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.config_prefix = cache.oslo {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.debug_cache_backend = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.enable_retry_client = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.enable_socket_keepalive = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.expiration_time = 600 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.hashclient_retry_attempts = 2 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_dead_retry = 300 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_pool_maxsize = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_sasl_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.proxies = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.redis_db = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.redis_server = localhost:6379 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.retry_attempts = 2 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.retry_delay = 0.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.socket_keepalive_count = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.socket_keepalive_idle = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.socket_keepalive_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.socket_timeout = 1.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.tls_allowed_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.tls_cafile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.tls_certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.tls_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.tls_keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86783) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cache.username = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] coordination.backend_url = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.asyncio_connection = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.asyncio_slave_connection = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.backend = sqlalchemy {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.connection = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.connection_debug = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.connection_parameters = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.connection_recycle_time = 3600 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.connection_trace = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.db_inc_retry_interval = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.db_max_retries = 20 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.db_max_retry_interval = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.db_retry_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.max_overflow = 50 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.max_pool_size = 5 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.max_retries = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.mysql_wsrep_sync_wait = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.pool_timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.retry_interval = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.slave_connection = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.sqlite_synchronous = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.synchronous_reader = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] database.use_db_reconnect = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_tracing.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.connection_string = messaging:// {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.es_doc_type = notification {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.es_scroll_size = 10000 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.es_scroll_time = 2m {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.filter_error_trace = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.hmac_keys = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.sentinel_service_name = mymaster {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.socket_timeout = 0.1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.trace_requests = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler.trace_sqlalchemy = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler_jaeger.process_tags = {} {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler_jaeger.service_name_prefix = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] profiler_otlp.service_name_prefix = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.enforce_new_defaults = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.policy_default_rule = default {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.policy_file = policy.yaml {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.group = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.helper_command = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] privsep_osbrick.user = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.group = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.helper_command = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] cinder_sys_admin.user = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.auth_section = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.auth_type = password {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.cafile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.collect_timing = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.send_service_user_token = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.split_loggers = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.tls_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] service_user.tls_min_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.auth_section = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.auth_type = password {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.collect_timing = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.region_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.split_loggers = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.tls_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] glance.tls_min_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.backend_availability_zone = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.chap_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.chap_username = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.disk_geometry = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_client_cert = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_client_cert_key = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_data_namespace = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.driver_use_ssl = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.extra_capabilities = {} {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.filter_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.goodness_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iscsi_target_flags = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iscsi_write_cache = on {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iser_helper = tgtadm {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iser_ip_address = 192.168.122.252 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iser_port = 3260 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_host = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_login = admin {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_mount_options = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_private_key = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_share_path = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.num_shell_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.quobyte_volume_url = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.replication_device = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.report_discard_supported = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.reserved_percentage = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_helper = tgtadm {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_ip_address = 192.168.122.252 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_port = 3260 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_protocol = iscsi {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.trace_flags = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.unique_fqdn_network = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.use_chap_auth = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_backend_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_clear = zero {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_clear_ionice = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_clear_size = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_reports.file_event_handler = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86783) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_reports.log_dir = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.backend_availability_zone = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.backend_host = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.chap_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Running cmd (subprocess): mount.quobyte {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.chap_username = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.chiscsi_conf = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.disk_geometry = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_client_cert = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_data_namespace = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.driver_use_ssl = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.extra_capabilities = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.filter_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.goodness_function = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iser_helper = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iser_ip_address = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iser_port = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.iser_target_prefix = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_host = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_login = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_mount_options = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_password = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_private_key = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_share_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_ssh_port = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.num_shell_tries = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.nvmet_port_id = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.replication_device = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.report_discard_supported = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.reserved_percentage = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.scst_target_driver = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.storage_protocol = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_helper = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_ip_address = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_port = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_prefix = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_protocol = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.trace_flags = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.use_chap_auth = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_clear = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_clear_size = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] QuobyteHD.volumes_dir = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_notifications.driver = [] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_notifications.retry = -1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] key_manager.fixed_key = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.barbican_api_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.barbican_endpoint = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.barbican_endpoint_type = public {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.barbican_region_name = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.cafile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.collect_timing = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.number_of_retries = 60 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.retry_delay = 1 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.send_service_user_token = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.split_loggers = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.tls_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.tls_min_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack quobyte-client[86784]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.verify_ssl = True {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican.verify_ssl_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.auth_section = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.auth_type = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.cafile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.certfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.collect_timing = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack quobyte-client[86784]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.insecure = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.keyfile = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.split_loggers = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.timeout = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.tls_ciphers = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] barbican_service_user.tls_min_version = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.approle_role_id = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.approle_secret_id = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.auth_method = approle {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.auth_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.kv_mountpoint = secret {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.kv_path = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.kv_version = 2 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.namespace = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.root_token_id = **** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.ssl_ca_crt_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.timeout = 60.0 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.token_file = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.token_role = None {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.use_ssl = False {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 10:43:53 devstack cinder-volume[86469]: DEBUG oslo_service.backend._eventlet.service [None req-53bbcf80-58bd-47d4-8fd8-f96fca7ae93f None None] ******************************************************************************** {{(pid=86469) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:53 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:53 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:53 devstack cinder-volume[86783]: INFO cinder.volume.driver [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.driver [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8103370666504, 'free_capacity_gb': 1773.8103370666504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writer thread running {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.db.api [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Building query based on filter {{(pid=86783) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86783) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:53 devstack cinder-volume[86783]: INFO cinder.keymgr.migration [None req-754fe530-7e09-4512-a6a8-5e249cf945aa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 10:43:53 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:53 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:54 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:43:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Driver initialization completed successfully. Nov 02 10:43:54 devstack cinder-volume[86783]: INFO cinder.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Initiating service 3 cleanup Nov 02 10:43:54 devstack cinder-volume[86783]: INFO cinder.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Service 3 cleanup completed. Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG cinder.service [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Creating RPC server for service cinder-volume {{(pid=86783) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG cinder.service [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86783) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 10:43:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:43:54 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:43:54 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:43:54 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Nov 02 10:43:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:43:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9ee848b-fb62-46d9-bc69-b30e5227ac22 None None] Driver post RPC initialization completed successfully. Nov 02 10:44:03 devstack cinder-volume[86469]: DEBUG dbcounter [-] [86469] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86469) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:44:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:44:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 6 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:44:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Flow 'volume_create_manager' (61422ac4-a58c-4bd6-a0ef-ab2ad8fd3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1227ed-1239-4f82-9b06-a0e18e7c031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1227ed-1239-4f82-9b06-a0e18e7c031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1623180856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f74b7cb9a842969bf464edf2e5669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:53Z,use_quota=True,user_id='12a241b7c8d7437986b6715758593a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f3fc0f-278a-4c6e-acfb-48ba758060bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f3fc0f-278a-4c6e-acfb-48ba758060bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c3fb3-58e5-4d8f-b982-a04a52235cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c3fb3-58e5-4d8f-b982-a04a52235cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3', 'volume_name': 'volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e396b32c-348a-4095-b219-afc0f9c897ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e396b32c-348a-4095-b219-afc0f9c897ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22f0ac9-9f23-4fd4-ac49-68fa4c6e58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Volume fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3', 'volume_size': 1} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1623180856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87f74b7cb9a842969bf464edf2e5669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:44:53Z,use_quota=True,user_id='12a241b7c8d7437986b6715758593a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Creating volume fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:44:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:53 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 1073741824 Nov 02 10:44:53 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:53 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 1073741824" returned: 0 in 0.672s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:44:53 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 Nov 02 10:44:53 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:44:54 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22f0ac9-9f23-4fd4-ac49-68fa4c6e58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d24632-8ba2-4704-9de2-5f50a9ee07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:44:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Volume volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 (fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3): created successfully Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d24632-8ba2-4704-9de2-5f50a9ee07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:44:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Flow 'volume_create_manager' (61422ac4-a58c-4bd6-a0ef-ab2ad8fd3e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:44:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-017ce963-e81f-4db5-93ce-7673d6e76844 tempest-TaggedAttachmentsTest-308626931 None] Created volume successfully. Nov 02 10:45:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Flow 'volume_create_manager' (5905b90d-ff31-4d0b-9975-03ec43bdb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4998af79-b874-49a4-90a6-d35e005f5bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4998af79-b874-49a4-90a6-d35e005f5bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-548088845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fadee6627a4628b4c27c19ddc731e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:07Z,use_quota=True,user_id='77821f01f9b14e03b77abcece73338c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdce020-1334-4ed7-b287-f7652cd5d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cdce020-1334-4ed7-b287-f7652cd5d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871b4d7-9630-4fcf-a4d1-518a7bf315c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871b4d7-9630-4fcf-a4d1-518a7bf315c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841', 'volume_name': 'volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb61fe0-264c-4de2-bf38-ad282068d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb61fe0-264c-4de2-bf38-ad282068d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3ff455-362d-4590-8459-c4348f79b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Volume a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841', 'volume_size': 1} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-548088845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fadee6627a4628b4c27c19ddc731e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:07Z,use_quota=True,user_id='77821f01f9b14e03b77abcece73338c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Creating volume a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:45:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:07 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 1073741824 Nov 02 10:45:07 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:08 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 1073741824" returned: 0 in 0.931s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:08 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 Nov 02 10:45:08 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:09 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3ff455-362d-4590-8459-c4348f79b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30048449-43c3-47c8-af5a-74b17d024e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Volume volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 (a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841): created successfully Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30048449-43c3-47c8-af5a-74b17d024e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Flow 'volume_create_manager' (5905b90d-ff31-4d0b-9975-03ec43bdb059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1b2bae1d-5912-4510-b827-48c713aad191 tempest-DeleteServersTestJSON-1253538400 None] Created volume successfully. Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:09 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:45:09 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:10 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.507s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:45:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 6 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:45:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:45:14 devstack cinder-volume[86783]: WARNING py.warnings [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 02 10:45:14 devstack cinder-volume[86783]: .first() Nov 02 10:45:14 devstack cinder-volume[86783]: Nov 02 10:45:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.105s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f77cb219-6906-4d04-a875-b8173d8109b6', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:45:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-b1341307-37b2-4351-8f4f-74027602071d req-e4f568af-19a9-4dd4-8618-6b3da74fd9df tempest-DeleteServersTestJSON-1253538400 None] attachment_update completed successfully. Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Flow 'volume_create_manager' (0dea4338-9c84-415e-a59a-3062a1af312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5748c8-3b8e-4297-9f52-8f8e8ce16f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5748c8-3b8e-4297-9f52-8f8e8ce16f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-429268537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d146a90-8f56-4acd-916e-282b08827e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999c611c43e14d6bb92ef3e7a57ae4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:22Z,use_quota=True,user_id='4197730b3f7140ccadf43a2f4c22b8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0be6f11-948f-4310-b0d3-3eb0b943cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0be6f11-948f-4310-b0d3-3eb0b943cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83233048-184d-410f-a1da-dca5972c0ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83233048-184d-410f-a1da-dca5972c0ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d146a90-8f56-4acd-916e-282b08827e4a', 'volume_name': 'volume-1d146a90-8f56-4acd-916e-282b08827e4a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7b280-fbfe-4dc3-aebb-bc58949c5cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb7b280-fbfe-4dc3-aebb-bc58949c5cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c6190-2361-4cca-a280-e4bff01027b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Volume 1d146a90-8f56-4acd-916e-282b08827e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d146a90-8f56-4acd-916e-282b08827e4a', 'volume_size': 1} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-429268537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d146a90-8f56-4acd-916e-282b08827e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999c611c43e14d6bb92ef3e7a57ae4d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:45:22Z,use_quota=True,user_id='4197730b3f7140ccadf43a2f4c22b8ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Creating volume 1d146a90-8f56-4acd-916e-282b08827e4a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:45:22 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:45:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:22 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a 1073741824 Nov 02 10:45:22 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:23 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a 1073741824" returned: 0 in 0.769s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:23 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a Nov 02 10:45:23 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:24 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a" returned: 0 in 0.513s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c6190-2361-4cca-a280-e4bff01027b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d146a90-8f56-4acd-916e-282b08827e4a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e8fc2a-b21d-404a-8239-31130347ff67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:45:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Volume volume-1d146a90-8f56-4acd-916e-282b08827e4a (1d146a90-8f56-4acd-916e-282b08827e4a): created successfully Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e8fc2a-b21d-404a-8239-31130347ff67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Flow 'volume_create_manager' (0dea4338-9c84-415e-a59a-3062a1af312a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:45:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-efa33dba-15c6-4817-8282-3391d2f9329b tempest-VolumesAdminNegativeTest-1686808493 None] Created volume successfully. Nov 02 10:45:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-310bf0bb-1bac-4bc2-af68-44e89780bbfb req-09233639-2774-4123-8e79-47f74de7b1e0 tempest-DeleteServersTestJSON-1253538400 None] Terminate volume connection completed successfully. Nov 02 10:45:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-310bf0bb-1bac-4bc2-af68-44e89780bbfb req-09233639-2774-4123-8e79-47f74de7b1e0 tempest-DeleteServersTestJSON-1253538400 None] Deleting attachment f77cb219-6906-4d04-a875-b8173d8109b6. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:45:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Acquiring lock "cinder-1d146a90-8f56-4acd-916e-282b08827e4a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "cinder-1d146a90-8f56-4acd-916e-282b08827e4a-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Acquiring lock "cinder-quobyte-1d146a90-8f56-4acd-916e-282b08827e4a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "cinder-quobyte-1d146a90-8f56-4acd-916e-282b08827e4a" acquired by "delete_volume" :: waited 0.062s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:25 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6qfi5qy6/privsep.sock'] Nov 02 10:45:25 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6qfi5qy6/privsep.sock Nov 02 10:45:25 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 10:45:26 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 10:45:27 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:27 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Spawned new privsep daemon via rootwrap Nov 02 10:45:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Accepted privsep connection to /tmp/tmp6qfi5qy6/privsep.sock {{(pid=86783) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 10:45:27 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 10:45:27 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 10:45:27 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 10:45:27 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88459 Nov 02 10:45:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1815ca3-215f-4276-a8f4-548ff85004e8]: (2,) {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[df113d43-abae-4528-9321-81d97b549d67]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:27 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a Nov 02 10:45:27 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a" returned: 0 in 0.759s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:28 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a Nov 02 10:45:28 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:28 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d146a90-8f56-4acd-916e-282b08827e4a" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "cinder-quobyte-1d146a90-8f56-4acd-916e-282b08827e4a" released by "delete_volume" :: held 3.232s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:28 devstack cinder-volume[86783]: WARNING cinder.quota [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:28 devstack cinder-volume[86783]: WARNING cinder.quota [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:45:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Created reservations ['75e385c1-8552-458f-a075-7f04b3987cdd', '57548db3-831d-4911-ab4e-379e9dd77f21', '13be490e-c62e-41f0-bb16-94eede0f7b39', 'd72d98ed-f8c9-4f1d-87a3-10be118fbc77'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "cinder-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:29 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:45:29 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "cinder-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "cinder-quobyte-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "cinder-quobyte-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3f0d75-13a4-4c8a-8927-8e93152f3389]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:29 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.457s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Deleted volume successfully. Nov 02 10:45:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8689f45a-6ad8-4f4e-a3a3-150bcabdce73 tempest-VolumesAdminNegativeTest-1686808493 None] Lock "cinder-1d146a90-8f56-4acd-916e-282b08827e4a-delete_volume" released by "delete_volume" :: held 4.429s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:29 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 Nov 02 10:45:29 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:30 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" returned: 0 in 0.782s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:30 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841 Nov 02 10:45:30 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:30 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "cinder-quobyte-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841" released by "delete_volume" :: held 1.350s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Created reservations ['8d58ffb5-58f0-4eb6-918b-73e8366201ff', '954f1a96-1ab6-494a-a62a-a6bbb545e64d', '7a029f90-e3e0-4f0d-b6fa-681d98fb0316', '4674c2ed-e02b-47ed-b218-8afec8a7acf5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:45:31 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:45:31 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:45:31 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:45:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Deleted volume successfully. Nov 02 10:45:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0dfbc130-e617-46bb-a2ae-d03e6ab01461 tempest-DeleteServersTestJSON-1253538400 None] Lock "cinder-a0df36e6-f1f2-4ec3-8dcc-3a8fb2974841-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:45:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:45:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=29,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4c4ce403-3a0d-4928-b6c7-31b6a4f7c8fe req-d0d02370-017c-436e-ad0c-b10e3d56e006 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4c4ce403-3a0d-4928-b6c7-31b6a4f7c8fe req-d0d02370-017c-436e-ad0c-b10e3d56e006 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4c4ce403-3a0d-4928-b6c7-31b6a4f7c8fe req-d0d02370-017c-436e-ad0c-b10e3d56e006 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-4c4ce403-3a0d-4928-b6c7-31b6a4f7c8fe req-d0d02370-017c-436e-ad0c-b10e3d56e006 tempest-TaggedAttachmentsTest-308626931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66f893fa-a1a2-4318-abe4-c463bf04dd1f', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:46:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-4c4ce403-3a0d-4928-b6c7-31b6a4f7c8fe req-d0d02370-017c-436e-ad0c-b10e3d56e006 tempest-TaggedAttachmentsTest-308626931 None] attachment_update completed successfully. Nov 02 10:46:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-2afc2643-6f60-4e26-9257-53627e5a84e8 req-7024bd0a-58a1-481a-820e-a5493ccb04fe tempest-TaggedAttachmentsTest-308626931 None] Terminate volume connection completed successfully. Nov 02 10:46:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-2afc2643-6f60-4e26-9257-53627e5a84e8 req-7024bd0a-58a1-481a-820e-a5493ccb04fe tempest-TaggedAttachmentsTest-308626931 None] Deleting attachment 66f893fa-a1a2-4318-abe4-c463bf04dd1f. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:09 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:46:09 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:10 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.957s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:18 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:18 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=9 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "cinder-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "cinder-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "cinder-quobyte-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "cinder-quobyte-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5ace8-1339-4795-ac64-a3555025eca6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 Nov 02 10:46:28 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:28 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:28 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3 Nov 02 10:46:28 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "cinder-quobyte-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3" released by "delete_volume" :: held 0.721s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Created reservations ['a19ef424-b311-4acb-99e4-7ffd8abf8169', '8f81cae9-0c27-4cee-97d8-0157edcd490c', '9ce78693-cdcc-4ffa-8f99-150f5ed16e2d', '32117f6a-521f-4f49-83c3-845ad9e88fd3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:29 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:46:29 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:29 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:46:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Deleted volume successfully. Nov 02 10:46:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6a58bcda-be68-458f-9858-e80484702669 tempest-TaggedAttachmentsTest-308626931 None] Lock "cinder-fb25aa55-ac4c-4afe-bb24-cedc5cad4ed3-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (e30aee32-2ac6-4fe4-88f2-ea195f1a38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e2eab2-5482-4b4c-9648-edb754185121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e2eab2-5482-4b4c-9648-edb754185121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694265728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe719c-2966-4533-9e6d-13eb035937dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:36Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8da02-056a-4669-8eeb-cd2d4b14764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f8da02-056a-4669-8eeb-cd2d4b14764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d8e018-0bb1-486a-b106-664c93c92abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d8e018-0bb1-486a-b106-664c93c92abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fe719c-2966-4533-9e6d-13eb035937dc', 'volume_name': 'volume-a9fe719c-2966-4533-9e6d-13eb035937dc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3854dbb0-559f-4b91-8fe2-8cff0b999dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3854dbb0-559f-4b91-8fe2-8cff0b999dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d33c6d1-1b3d-4f1d-b30f-e6760a199b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Volume a9fe719c-2966-4533-9e6d-13eb035937dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fe719c-2966-4533-9e6d-13eb035937dc', 'volume_size': 1} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694265728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fe719c-2966-4533-9e6d-13eb035937dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:36Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Creating volume a9fe719c-2966-4533-9e6d-13eb035937dc {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:36 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:46:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:36 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc 1073741824 Nov 02 10:46:36 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:37 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc 1073741824" returned: 0 in 0.809s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:37 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc Nov 02 10:46:37 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:37 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d33c6d1-1b3d-4f1d-b30f-e6760a199b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fe719c-2966-4533-9e6d-13eb035937dc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74119346-f03d-43e0-8709-83a2087ba0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Volume volume-a9fe719c-2966-4533-9e6d-13eb035937dc (a9fe719c-2966-4533-9e6d-13eb035937dc): created successfully Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74119346-f03d-43e0-8709-83a2087ba0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (e30aee32-2ac6-4fe4-88f2-ea195f1a38af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2476ee70-1cce-4b4d-8521-8508d2184e7a tempest-AttachVolumeNegativeTest-228869102 None] Created volume successfully. Nov 02 10:46:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6189c606-409c-4d67-b3fb-0ccdfd5dba57 req-d2ffdf52-0c58-4798-bea5-3c4bb2441b1c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6189c606-409c-4d67-b3fb-0ccdfd5dba57 req-d2ffdf52-0c58-4798-bea5-3c4bb2441b1c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6189c606-409c-4d67-b3fb-0ccdfd5dba57 req-d2ffdf52-0c58-4798-bea5-3c4bb2441b1c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-6189c606-409c-4d67-b3fb-0ccdfd5dba57 req-d2ffdf52-0c58-4798-bea5-3c4bb2441b1c tempest-AttachVolumeNegativeTest-228869102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-a9fe719c-2966-4533-9e6d-13eb035937dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5de1733a-1bd9-45f1-b859-0368adddef42', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:46:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-6189c606-409c-4d67-b3fb-0ccdfd5dba57 req-d2ffdf52-0c58-4798-bea5-3c4bb2441b1c tempest-AttachVolumeNegativeTest-228869102 None] attachment_update completed successfully. Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Flow 'volume_create_manager' (f8cfb995-da0c-4219-be06-dc5369404517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aacf2e6-6c2f-49ea-8933-0c43e13aabef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aacf2e6-6c2f-49ea-8933-0c43e13aabef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2145686415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01254f3-e106-45b5-beb4-8a8ddf3867c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df38aabd5194882bcc24f47f99b5a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:40Z,use_quota=True,user_id='22c443df0784442db6365a4f88a3c536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f1ea37-17ee-4427-90f8-69b7a6edf2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f1ea37-17ee-4427-90f8-69b7a6edf2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6261f90b-7041-4efa-8980-4400ffead6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6261f90b-7041-4efa-8980-4400ffead6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'volume_name': 'volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1bced8-b3ea-48bb-a62f-f121237d9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1bced8-b3ea-48bb-a62f-f121237d9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06541173-8f42-4db8-b6b3-5a9040c38863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Volume f01254f3-e106-45b5-beb4-8a8ddf3867c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'volume_size': 1} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2145686415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01254f3-e106-45b5-beb4-8a8ddf3867c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df38aabd5194882bcc24f47f99b5a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:46:40Z,use_quota=True,user_id='22c443df0784442db6365a4f88a3c536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Creating volume f01254f3-e106-45b5-beb4-8a8ddf3867c5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:46:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:46:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:40 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 1073741824 Nov 02 10:46:40 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 1073741824" returned: 0 in 0.783s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:46:41 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 Nov 02 10:46:41 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:46:41 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06541173-8f42-4db8-b6b3-5a9040c38863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2748b8f1-e8ba-4fd0-aa33-b02dd47ae70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:46:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Volume volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 (f01254f3-e106-45b5-beb4-8a8ddf3867c5): created successfully Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2748b8f1-e8ba-4fd0-aa33-b02dd47ae70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:46:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Flow 'volume_create_manager' (f8cfb995-da0c-4219-be06-dc5369404517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:46:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a952552a-f2ca-41d0-b6d3-b3620df185b5 tempest-ServerActionsTestOtherA-2065570522 None] Created volume successfully. Nov 02 10:46:51 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=18,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:46:51 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Flow 'volume_create_manager' (284405fc-dca0-42ee-94e3-8520090cc27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90339d2f-8122-4ebe-8148-7cc57b677163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90339d2f-8122-4ebe-8148-7cc57b677163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-4773262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49659fac-de79-4606-9d30-d88474127a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc5559605f884802b0c254a1dc083980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:02Z,use_quota=True,user_id='eaa64c51f3fc4b909dab39897ca2e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903b7f73-ec3b-44fe-97a0-d2f1b0426208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903b7f73-ec3b-44fe-97a0-d2f1b0426208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2465cf4-d429-4d52-beaf-ba205b5da3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2465cf4-d429-4d52-beaf-ba205b5da3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49659fac-de79-4606-9d30-d88474127a3b', 'volume_name': 'volume-49659fac-de79-4606-9d30-d88474127a3b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf73774-2878-4997-9665-ed939aadf5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf73774-2878-4997-9665-ed939aadf5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873257e8-ba7e-4473-8fcb-6cec56816f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Volume 49659fac-de79-4606-9d30-d88474127a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49659fac-de79-4606-9d30-d88474127a3b', 'volume_size': 1} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-4773262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49659fac-de79-4606-9d30-d88474127a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc5559605f884802b0c254a1dc083980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:02Z,use_quota=True,user_id='eaa64c51f3fc4b909dab39897ca2e5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Creating volume 49659fac-de79-4606-9d30-d88474127a3b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:47:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b 1073741824 Nov 02 10:47:02 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:02 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b 1073741824" returned: 0 in 0.719s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:02 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b Nov 02 10:47:02 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:03 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873257e8-ba7e-4473-8fcb-6cec56816f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49659fac-de79-4606-9d30-d88474127a3b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5640641f-126a-4792-a73c-737ea81f1efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Volume volume-49659fac-de79-4606-9d30-d88474127a3b (49659fac-de79-4606-9d30-d88474127a3b): created successfully Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5640641f-126a-4792-a73c-737ea81f1efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Flow 'volume_create_manager' (284405fc-dca0-42ee-94e3-8520090cc27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9abe620d-8d4f-4823-a99e-acdea2a21c4d tempest-AttachVolumeShelveTestJSON-1368445971 None] Created volume successfully. Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:09 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:47:09 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:10 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.767s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:47:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 8 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:47:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:47:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-138acc67-e683-4bae-8e3c-49f60965e2ae req-5eccd5fd-c311-4c66-a79b-c9a0349c95fe tempest-AttachVolumeShelveTestJSON-1368445971 None] No connector for attachment c2fa263b-20c6-45ed-ab05-baed089a0a44; skipping storage backend terminate_connection call. {{(pid=86783) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 10:47:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-138acc67-e683-4bae-8e3c-49f60965e2ae req-5eccd5fd-c311-4c66-a79b-c9a0349c95fe tempest-AttachVolumeShelveTestJSON-1368445971 None] Deleting attachment c2fa263b-20c6-45ed-ab05-baed089a0a44. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:47:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0eccd29-1b31-49a8-ae6b-c43e1e560568 req-4dff7a0c-e446-4c4c-a238-c18e01eaa503 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0eccd29-1b31-49a8-ae6b-c43e1e560568 req-4dff7a0c-e446-4c4c-a238-c18e01eaa503 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0eccd29-1b31-49a8-ae6b-c43e1e560568 req-4dff7a0c-e446-4c4c-a238-c18e01eaa503 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c0eccd29-1b31-49a8-ae6b-c43e1e560568 req-4dff7a0c-e446-4c4c-a238-c18e01eaa503 tempest-ServerActionsTestOtherA-2065570522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '092e9080-5abb-4097-8cca-8e7ea06e92cc', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:47:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c0eccd29-1b31-49a8-ae6b-c43e1e560568 req-4dff7a0c-e446-4c4c-a238-c18e01eaa503 tempest-ServerActionsTestOtherA-2065570522 None] attachment_update completed successfully. Nov 02 10:47:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:47:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Flow 'volume_create_manager' (9d61d7a7-5470-48ae-afa9-645f8d7d260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e149ecb7-ee7c-4899-ab75-06ae72c72dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e149ecb7-ee7c-4899-ab75-06ae72c72dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-50212616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbbbb6e1a7f4debbdd2cb6c07ecf503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:33Z,use_quota=True,user_id='c985853807024736b2c4eb9faaf7ba79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dd945-5919-4920-800e-3a87d7427140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dd945-5919-4920-800e-3a87d7427140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104faea-5e50-4da5-bfeb-4909bb949032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104faea-5e50-4da5-bfeb-4909bb949032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b', 'volume_name': 'volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c59427-25a0-4a21-8a98-dc93999b79cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c59427-25a0-4a21-8a98-dc93999b79cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e7fc11-5933-4cc5-8c3d-fbde834a3ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Volume ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b', 'volume_size': 1} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-50212616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbbbb6e1a7f4debbdd2cb6c07ecf503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:47:33Z,use_quota=True,user_id='c985853807024736b2c4eb9faaf7ba79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Creating volume ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:47:33 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:33 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b 1073741824 Nov 02 10:47:33 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-1e2f566f-b8c6-4d88-bed0-938cec91fec3 tempest-ServerActionsTestOtherA-2065570522 None] Terminate volume connection completed successfully. Nov 02 10:47:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-1e2f566f-b8c6-4d88-bed0-938cec91fec3 tempest-ServerActionsTestOtherA-2065570522 None] Deleting attachment 092e9080-5abb-4097-8cca-8e7ea06e92cc. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:47:34 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b 1073741824" returned: 0 in 1.477s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:35 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b Nov 02 10:47:35 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:35 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" returned: 0 in 0.620s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-04258c43-7c45-4eee-864b-504ce7081c1e tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-04258c43-7c45-4eee-864b-504ce7081c1e tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e7fc11-5933-4cc5-8c3d-fbde834a3ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23c65f4-b8b2-405b-a7ea-7f76bb0e20fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-04258c43-7c45-4eee-864b-504ce7081c1e tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Volume volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b (ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b): created successfully Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23c65f4-b8b2-405b-a7ea-7f76bb0e20fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Flow 'volume_create_manager' (9d61d7a7-5470-48ae-afa9-645f8d7d260c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:47:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-111fe191-509b-48ec-8b72-0de5a9050127 tempest-ServerRescueNegativeTestJSON-1775638314 None] Created volume successfully. Nov 02 10:47:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-04258c43-7c45-4eee-864b-504ce7081c1e tempest-ServerActionsTestOtherA-2065570522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd952a413-a994-4b53-95c0-4453d1fb335d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:47:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-906cbdeb-6fa3-4889-bb9f-8738f96b71fb req-04258c43-7c45-4eee-864b-504ce7081c1e tempest-ServerActionsTestOtherA-2065570522 None] attachment_update completed successfully. Nov 02 10:47:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-75a20c71-9dee-4576-bb78-4d954c9d816d req-a47a7066-8309-4bc0-a352-fb4f1d15885a tempest-AttachVolumeNegativeTest-228869102 None] Terminate volume connection completed successfully. Nov 02 10:47:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-75a20c71-9dee-4576-bb78-4d954c9d816d req-a47a7066-8309-4bc0-a352-fb4f1d15885a tempest-AttachVolumeNegativeTest-228869102 None] Deleting attachment 5de1733a-1bd9-45f1-b859-0368adddef42. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:47:45 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:46 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Acquiring lock "cinder-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "cinder-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Acquiring lock "cinder-quobyte-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "cinder-quobyte-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce79f29-1734-414e-a3ea-36c9ca30bd89]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:47:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:52 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b Nov 02 10:47:52 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:53 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" returned: 0 in 0.692s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:53 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b Nov 02 10:47:53 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:53 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "cinder-quobyte-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b" released by "delete_volume" :: held 1.245s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Created reservations ['a9984ff6-62c2-45f8-a098-5d8735b81466', '0fa96617-0efb-4864-a54e-7167a3c3d669', '2c7d3d71-4e77-4148-8ef9-5d20c8458e13', '6584afcc-4227-4fb2-bdcf-47072c5f0051'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:47:54 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:47:54 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:47:54 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:47:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Deleted volume successfully. Nov 02 10:47:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-995221d4-eb3f-4491-9473-7630389368eb tempest-ServerRescueNegativeTestJSON-1775638314 None] Lock "cinder-ba0d6e48-31e5-4a53-8ec1-88ab72ecc69b-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:04 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:09 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:48:09 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:10 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:48:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 8 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:48:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:48:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-e7aff501-eef6-4a85-977d-1483c1754884 req-63d40070-47fe-460b-b20c-02cb23f9ebcf tempest-ServerActionsTestOtherA-2065570522 None] Terminate volume connection completed successfully. Nov 02 10:48:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-e7aff501-eef6-4a85-977d-1483c1754884 req-63d40070-47fe-460b-b20c-02cb23f9ebcf tempest-ServerActionsTestOtherA-2065570522 None] Deleting attachment d952a413-a994-4b53-95c0-4453d1fb335d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (afd699a3-8063-4029-b974-b704c240da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f4de1-94d3-4ab6-a323-52f3e936de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27f4de1-94d3-4ab6-a323-52f3e936de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-49846250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43635f4b-1793-47bb-bd37-68df3a21ae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:30Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2b2366-01d5-4e08-becf-8fe99e911f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2b2366-01d5-4e08-becf-8fe99e911f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9351a072-5877-41d4-9fbd-c2a3aa6de923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9351a072-5877-41d4-9fbd-c2a3aa6de923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43635f4b-1793-47bb-bd37-68df3a21ae0e', 'volume_name': 'volume-43635f4b-1793-47bb-bd37-68df3a21ae0e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6d152-b68d-45e3-b9f2-25aca26cbb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c6d152-b68d-45e3-b9f2-25aca26cbb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b34ab27-85ee-4ef3-9ed7-1b15d1c607c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Volume 43635f4b-1793-47bb-bd37-68df3a21ae0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43635f4b-1793-47bb-bd37-68df3a21ae0e', 'volume_size': 1} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-49846250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43635f4b-1793-47bb-bd37-68df3a21ae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:30Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Creating volume 43635f4b-1793-47bb-bd37-68df3a21ae0e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:48:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:30 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e 1073741824 Nov 02 10:48:30 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:31 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e 1073741824" returned: 0 in 0.680s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:31 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e Nov 02 10:48:31 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:31 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b34ab27-85ee-4ef3-9ed7-1b15d1c607c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43635f4b-1793-47bb-bd37-68df3a21ae0e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12cf425-a945-4193-a2df-44d10848f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Volume volume-43635f4b-1793-47bb-bd37-68df3a21ae0e (43635f4b-1793-47bb-bd37-68df3a21ae0e): created successfully Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12cf425-a945-4193-a2df-44d10848f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (afd699a3-8063-4029-b974-b704c240da3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5954a3f6-f721-4bd4-a477-67de5442b9f8 tempest-AttachVolumeNegativeTest-228869102 None] Created volume successfully. Nov 02 10:48:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2081116-d994-4ce9-b82a-ea81b77a7b20 req-46f00aaf-070a-4857-98cc-a464084c8a5f tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2081116-d994-4ce9-b82a-ea81b77a7b20 req-46f00aaf-070a-4857-98cc-a464084c8a5f tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2081116-d994-4ce9-b82a-ea81b77a7b20 req-46f00aaf-070a-4857-98cc-a464084c8a5f tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-d2081116-d994-4ce9-b82a-ea81b77a7b20 req-46f00aaf-070a-4857-98cc-a464084c8a5f tempest-AttachVolumeNegativeTest-228869102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-43635f4b-1793-47bb-bd37-68df3a21ae0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2cceebe-3d92-4c55-a37a-05f89816dea7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-d2081116-d994-4ce9-b82a-ea81b77a7b20 req-46f00aaf-070a-4857-98cc-a464084c8a5f tempest-AttachVolumeNegativeTest-228869102 None] attachment_update completed successfully. Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Flow 'volume_create_manager' (aea2fe31-c7d3-491c-b246-b73783fa1a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d78153-5bbb-45a0-9d51-ed8709796382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d78153-5bbb-45a0-9d51-ed8709796382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-913624858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22d22ee-95bb-4d87-8f8f-dd9cec1b595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df38aabd5194882bcc24f47f99b5a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:35Z,use_quota=True,user_id='22c443df0784442db6365a4f88a3c536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00adbc7b-bf50-4ac0-9b8d-d45e0dfa5c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00adbc7b-bf50-4ac0-9b8d-d45e0dfa5c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6239e39f-da8a-409b-9b14-acc4b65dc76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Acquiring lock "cinder-49659fac-de79-4606-9d30-d88474127a3b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "cinder-49659fac-de79-4606-9d30-d88474127a3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Acquiring lock "cinder-quobyte-49659fac-de79-4606-9d30-d88474127a3b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "cinder-quobyte-49659fac-de79-4606-9d30-d88474127a3b" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb2a5f0-9a59-4f11-ab00-46cf021959b8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:35 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b Nov 02 10:48:35 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6239e39f-da8a-409b-9b14-acc4b65dc76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'volume_name': 'volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a81463-739e-46ee-bd03-6d5bfa557e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a81463-739e-46ee-bd03-6d5bfa557e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddb2a67-1757-4bfd-b104-1ae3a122a1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Trying to clone a22d22ee-95bb-4d87-8f8f-dd9cec1b595b from image 134ee211-162c-468b-b66a-c0628be004d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:48:36 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b" returned: 0 in 1.006s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:36 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b Nov 02 10:48:36 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:48:36 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1d15af-a120-44b1-a931-ee33c28d4d1a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:37 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD Nov 02 10:48:37 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:37 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-49659fac-de79-4606-9d30-d88474127a3b" returned: 0 in 0.490s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "cinder-quobyte-49659fac-de79-4606-9d30-d88474127a3b" released by "delete_volume" :: held 1.609s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Created reservations ['9a9c200f-eeee-4996-9da9-71b3f5016b91', 'ca475553-d1b9-47ac-b6e0-f42ab005a1ce', '96263803-5ac1-4747-a6b7-10ac922c3786', 'cae62521-8abf-4601-8a94-99223fb55fbc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:37 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:48:37 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:37 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 is fetched for user 22c443df0784442db6365a4f88a3c536. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[be153830-a8b0-4a10-a05d-c9cddc783b34]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-5cc9a0af-f26e-4a1a-97f3-a08fa133bf24 req-19457648-941e-4cca-b431-1bbf9ec1f338 tempest-AttachVolumeNegativeTest-228869102 None] Terminate volume connection completed successfully. Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-5cc9a0af-f26e-4a1a-97f3-a08fa133bf24 req-19457648-941e-4cca-b431-1bbf9ec1f338 tempest-AttachVolumeNegativeTest-228869102 None] Deleting attachment a2cceebe-3d92-4c55-a37a-05f89816dea7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:48:38 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD Nov 02 10:48:38 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:38 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.766s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:48:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Deleted volume successfully. Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce7b185-27dc-4c81-bfef-d02411af4214 tempest-AttachVolumeShelveTestJSON-1368445971 None] Lock "cinder-49659fac-de79-4606-9d30-d88474127a3b-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:48:38 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-913624858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22d22ee-95bb-4d87-8f8f-dd9cec1b595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df38aabd5194882bcc24f47f99b5a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:35Z,use_quota=True,user_id='22c443df0784442db6365a4f88a3c536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Creating volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:38 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:48:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:38 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1073741824 Nov 02 10:48:38 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:39 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1073741824" returned: 0 in 0.746s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:39 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b Nov 02 10:48:39 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:39 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" returned: 0 in 0.360s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Attempting download of 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1331f2ec-6e6d-47c4-9de6-c67b0cecb56e]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:40 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6 Nov 02 10:48:40 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:40 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6" returned: 0 in 0.578s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:40 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6 Nov 02 10:48:40 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:41 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6" returned: 1 in 0.716s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_adc50fm6' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a59ba-c43e-46ff-8054-6368f6d156de]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:41 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD Nov 02 10:48:41 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:41 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] 134ee211-162c-468b-b66a-c0628be004d6 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:48:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:41 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b Nov 02 10:48:41 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:44 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" returned: 0 in 3.061s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:44 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_o_9a1ywldevstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:48:44 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Converted 112.00 MB image at 36.55 MB/s Nov 02 10:48:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:44 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1G Nov 02 10:48:44 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:45 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b 1G" returned: 0 in 0.840s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Downloaded image 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 for user 22c443df0784442db6365a4f88a3c536 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Marking volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Copying metadata from image 134ee211-162c-468b-b66a-c0628be004d6 to a22d22ee-95bb-4d87-8f8f-dd9cec1b595b. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Creating volume glance metadata for volume a22d22ee-95bb-4d87-8f8f-dd9cec1b595b backed by image 134ee211-162c-468b-b66a-c0628be004d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dddb2a67-1757-4bfd-b104-1ae3a122a1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c60025-b44e-4a6d-819e-b149d4df4b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:45 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Volume volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b (a22d22ee-95bb-4d87-8f8f-dd9cec1b595b): created successfully Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c60025-b44e-4a6d-819e-b149d4df4b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Flow 'volume_create_manager' (aea2fe31-c7d3-491c-b246-b73783fa1a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-254d7a7e-6e02-4799-91f5-3565f3e709e3 tempest-ServerActionsTestOtherA-2065570522 None] Created volume successfully. Nov 02 10:48:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7aa4e2fb-2d46-4856-930d-eaf2f2279ba0 req-c0b234d7-ac43-4ff9-b53b-fede6987aea7 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7aa4e2fb-2d46-4856-930d-eaf2f2279ba0 req-c0b234d7-ac43-4ff9-b53b-fede6987aea7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7aa4e2fb-2d46-4856-930d-eaf2f2279ba0 req-c0b234d7-ac43-4ff9-b53b-fede6987aea7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-7aa4e2fb-2d46-4856-930d-eaf2f2279ba0 req-c0b234d7-ac43-4ff9-b53b-fede6987aea7 tempest-ServerActionsTestOtherA-2065570522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6361e40f-bb90-48a9-86ad-59c6c81196e8', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:48:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-7aa4e2fb-2d46-4856-930d-eaf2f2279ba0 req-c0b234d7-ac43-4ff9-b53b-fede6987aea7 tempest-ServerActionsTestOtherA-2065570522 None] attachment_update completed successfully. Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Flow 'volume_create_manager' (9374e694-f357-4beb-b170-95ca53a60b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13715dd6-c054-47e5-a976-7b770305cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13715dd6-c054-47e5-a976-7b770305cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936896342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330433a-81bc-4ac1-b22e-1b9ee30814ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53f1d374c9d4692ac337aec05e1653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:56Z,use_quota=True,user_id='0981c82bcd664d0398d6670da998d880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3082d699-bd9b-4be5-805e-5de72e55f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3082d699-bd9b-4be5-805e-5de72e55f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9acfdb-7128-477c-8a72-5db2bb3be8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9acfdb-7128-477c-8a72-5db2bb3be8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4330433a-81bc-4ac1-b22e-1b9ee30814ff', 'volume_name': 'volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca92a47-cacc-4395-8df8-f046599d505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca92a47-cacc-4395-8df8-f046599d505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54beb3af-7826-420c-a73f-e4dea472a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Volume 4330433a-81bc-4ac1-b22e-1b9ee30814ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff', 'volume_size': 1} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-936896342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330433a-81bc-4ac1-b22e-1b9ee30814ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53f1d374c9d4692ac337aec05e1653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:48:56Z,use_quota=True,user_id='0981c82bcd664d0398d6670da998d880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Creating volume 4330433a-81bc-4ac1-b22e-1b9ee30814ff {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:48:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:48:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:55 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff 1073741824 Nov 02 10:48:55 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:56 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff 1073741824" returned: 0 in 0.970s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:48:56 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff Nov 02 10:48:56 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:48:57 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54beb3af-7826-420c-a73f-e4dea472a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81684e3a-1616-47b5-931f-d258b0b20832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:48:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Volume volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff (4330433a-81bc-4ac1-b22e-1b9ee30814ff): created successfully Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81684e3a-1616-47b5-931f-d258b0b20832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:48:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Flow 'volume_create_manager' (9374e694-f357-4beb-b170-95ca53a60b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:48:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2817f32c-52ec-4ec6-8b01-1f7ef31f15b3 tempest-ServersNegativeTestJSON-1817463438 None] Created volume successfully. Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Flow 'volume_create_manager' (5ffd40d5-f50d-4371-b2fc-8cec80f14152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7611f6-1b95-4300-ac3c-a3065bb31d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7611f6-1b95-4300-ac3c-a3065bb31d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-770012196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4800e5ac-d42d-4151-a636-e588f62d5d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53f1d374c9d4692ac337aec05e1653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:04Z,use_quota=True,user_id='0981c82bcd664d0398d6670da998d880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b1f3b8-3983-4bf1-84ae-ef02b9ffecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b1f3b8-3983-4bf1-84ae-ef02b9ffecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d31e6be-e2cf-43f3-9a02-188b521f8bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d31e6be-e2cf-43f3-9a02-188b521f8bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4800e5ac-d42d-4151-a636-e588f62d5d25', 'volume_name': 'volume-4800e5ac-d42d-4151-a636-e588f62d5d25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67e271-98b2-47f3-97c2-290721a6a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67e271-98b2-47f3-97c2-290721a6a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a87f77-4e1e-44ea-96a1-60414a310c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Volume 4800e5ac-d42d-4151-a636-e588f62d5d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4800e5ac-d42d-4151-a636-e588f62d5d25', 'volume_size': 1} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-770012196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4800e5ac-d42d-4151-a636-e588f62d5d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53f1d374c9d4692ac337aec05e1653a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:04Z,use_quota=True,user_id='0981c82bcd664d0398d6670da998d880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Creating volume 4800e5ac-d42d-4151-a636-e588f62d5d25 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:49:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:04 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 1073741824 Nov 02 10:49:04 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:05 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 1073741824" returned: 0 in 1.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:06 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 Nov 02 10:49:06 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:06 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25" returned: 0 in 0.648s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a87f77-4e1e-44ea-96a1-60414a310c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4800e5ac-d42d-4151-a636-e588f62d5d25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef151f4-1542-445b-949d-c4aad5e6f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Volume volume-4800e5ac-d42d-4151-a636-e588f62d5d25 (4800e5ac-d42d-4151-a636-e588f62d5d25): created successfully Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef151f4-1542-445b-949d-c4aad5e6f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Flow 'volume_create_manager' (5ffd40d5-f50d-4371-b2fc-8cec80f14152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-805d15e6-f870-4380-b4fd-46997bcafa7a tempest-ServersNegativeTestJSON-1817463438 None] Created volume successfully. Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:09 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:09 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:10 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.605s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "cinder-4800e5ac-d42d-4151-a636-e588f62d5d25-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-4800e5ac-d42d-4151-a636-e588f62d5d25-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "cinder-quobyte-4800e5ac-d42d-4151-a636-e588f62d5d25" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-quobyte-4800e5ac-d42d-4151-a636-e588f62d5d25" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8531f-df68-421e-81cc-7e677a61618d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:11 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 Nov 02 10:49:11 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:11 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25" returned: 0 in 0.766s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:11 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25 Nov 02 10:49:11 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:12 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4800e5ac-d42d-4151-a636-e588f62d5d25" returned: 0 in 0.623s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-quobyte-4800e5ac-d42d-4151-a636-e588f62d5d25" released by "delete_volume" :: held 1.490s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Created reservations ['081b1c4d-e09d-45d1-881c-553767bb1f39', '3c0a13f4-ea83-4f5b-aab1-f8bcef9dad15', '3d8a135a-eb56-4926-b449-59e6e1f44c62', 'c7ad1f10-c86d-40d0-832e-baec54e632a3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:12 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:12 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:13 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.482s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Deleted volume successfully. Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-725e3e44-1ebb-4cb5-a33a-13ea5b8acc8a tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-4800e5ac-d42d-4151-a636-e588f62d5d25-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "cinder-4330433a-81bc-4ac1-b22e-1b9ee30814ff-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-4330433a-81bc-4ac1-b22e-1b9ee30814ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "cinder-quobyte-4330433a-81bc-4ac1-b22e-1b9ee30814ff" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-quobyte-4330433a-81bc-4ac1-b22e-1b9ee30814ff" acquired by "delete_volume" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb7308a-f59b-4949-8196-fb71f20670dd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:13 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff Nov 02 10:49:13 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:14 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff" returned: 0 in 0.846s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:14 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff Nov 02 10:49:14 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:15 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4330433a-81bc-4ac1-b22e-1b9ee30814ff" returned: 0 in 1.040s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-quobyte-4330433a-81bc-4ac1-b22e-1b9ee30814ff" released by "delete_volume" :: held 2.004s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:15 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=42,cinder:INSERT=15,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:15 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=43,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Created reservations ['de2ab182-1fb9-4eef-ae18-9dfd8e64a833', 'c03009fe-1de2-47b9-886f-f3ce78f0ed7b', '4cda1f52-d064-4396-91fa-07f4722b3405', 'f07b46b2-6949-48ea-9066-61d38a790d90'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:16 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:16 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:16 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.531s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Deleted volume successfully. Nov 02 10:49:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d578c8f6-525b-4648-b902-e41016afe9ba tempest-ServersNegativeTestJSON-1817463438 None] Lock "cinder-4330433a-81bc-4ac1-b22e-1b9ee30814ff-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-c52d7f56-c0f6-4a92-a95a-996d4f8b987c tempest-ServerActionsTestOtherA-2065570522 None] Terminate volume connection completed successfully. Nov 02 10:49:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-c52d7f56-c0f6-4a92-a95a-996d4f8b987c tempest-ServerActionsTestOtherA-2065570522 None] Deleting attachment 6361e40f-bb90-48a9-86ad-59c6c81196e8. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-e5493f8a-4be8-4e9f-920f-b959b381ca2f tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-e5493f8a-4be8-4e9f-920f-b959b381ca2f tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-e5493f8a-4be8-4e9f-920f-b959b381ca2f tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-e5493f8a-4be8-4e9f-920f-b959b381ca2f tempest-ServerActionsTestOtherA-2065570522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33f7bb08-418b-4445-b3ad-18206e61615a', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:49:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-91422374-4b3a-47ca-a1f9-76dcace95764 req-e5493f8a-4be8-4e9f-920f-b959b381ca2f tempest-ServerActionsTestOtherA-2065570522 None] attachment_update completed successfully. Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (8252290e-55ab-45b3-b6f5-7fedfa3e73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dd0755-e62c-47ee-9118-f913e7cc876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dd0755-e62c-47ee-9118-f913e7cc876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-872550964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf5703-150e-4eaa-a81d-88e6b12eae83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:35Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1535514-f77b-48f5-b0ca-c5f472ae0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1535514-f77b-48f5-b0ca-c5f472ae0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4dbc74-e473-46d6-8ea1-5256890799e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4dbc74-e473-46d6-8ea1-5256890799e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cf5703-150e-4eaa-a81d-88e6b12eae83', 'volume_name': 'volume-84cf5703-150e-4eaa-a81d-88e6b12eae83', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d404f650-205f-4251-9a11-029de875b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d404f650-205f-4251-9a11-029de875b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d0f3e4-4107-491c-a1b0-a9f7086d598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Volume 84cf5703-150e-4eaa-a81d-88e6b12eae83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cf5703-150e-4eaa-a81d-88e6b12eae83', 'volume_size': 1} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-872550964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf5703-150e-4eaa-a81d-88e6b12eae83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c2370ccdf544218f706cd3b8a4c499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:35Z,use_quota=True,user_id='0ff39d9ad6f14f268f907496b0c3d197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Creating volume 84cf5703-150e-4eaa-a81d-88e6b12eae83 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:49:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:35 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 1073741824 Nov 02 10:49:35 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:36 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=2,cinder:UPDATE=8,cinder:SELECT=11 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:49:36 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 1073741824" returned: 0 in 1.109s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:36 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 Nov 02 10:49:36 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Flow 'volume_create_manager' (12800e43-0b26-4cf4-bc54-24b7a4753dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a977c4-6560-45f9-9e36-aee54d072ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a977c4-6560-45f9-9e36-aee54d072ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1760290752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e216529-bb80-49ce-9126-6eb2ab4a478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd11799f2154e39aeaae47f3635cd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:37Z,use_quota=True,user_id='f5a9789133e7448c8687a3f7e9f121cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dcef0e-6c77-43a0-9b14-df1f41ddf728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dcef0e-6c77-43a0-9b14-df1f41ddf728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c6fa0d-f4b0-488a-a618-6969264d522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c6fa0d-f4b0-488a-a618-6969264d522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e216529-bb80-49ce-9126-6eb2ab4a478e', 'volume_name': 'volume-7e216529-bb80-49ce-9126-6eb2ab4a478e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b3ba9f-1dae-4dea-816c-181999e46358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b3ba9f-1dae-4dea-816c-181999e46358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8874fa91-c715-4f80-8dad-3faff293de16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Volume 7e216529-bb80-49ce-9126-6eb2ab4a478e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e216529-bb80-49ce-9126-6eb2ab4a478e', 'volume_size': 1} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83" returned: 0 in 0.661s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1760290752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e216529-bb80-49ce-9126-6eb2ab4a478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd11799f2154e39aeaae47f3635cd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:37Z,use_quota=True,user_id='f5a9789133e7448c8687a3f7e9f121cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Creating volume 7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:37 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d0f3e4-4107-491c-a1b0-a9f7086d598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cf5703-150e-4eaa-a81d-88e6b12eae83', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e 1073741824 Nov 02 10:49:37 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2897f-fa70-4e90-877a-9e599c0d21f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Volume volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 (84cf5703-150e-4eaa-a81d-88e6b12eae83): created successfully Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2897f-fa70-4e90-877a-9e599c0d21f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Flow 'volume_create_manager' (8252290e-55ab-45b3-b6f5-7fedfa3e73d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0d4fd767-eb1d-4789-9d41-69103e978d3c tempest-AttachVolumeNegativeTest-228869102 None] Created volume successfully. Nov 02 10:49:37 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e 1073741824" returned: 0 in 0.566s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:37 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e Nov 02 10:49:37 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:38 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8874fa91-c715-4f80-8dad-3faff293de16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e216529-bb80-49ce-9126-6eb2ab4a478e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697b7209-5384-410c-8552-151049c057a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:38 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Volume volume-7e216529-bb80-49ce-9126-6eb2ab4a478e (7e216529-bb80-49ce-9126-6eb2ab4a478e): created successfully Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697b7209-5384-410c-8552-151049c057a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Flow 'volume_create_manager' (12800e43-0b26-4cf4-bc54-24b7a4753dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-eb9e3cb0-6c22-4346-bec4-a5a6aef77a5f req-f6f1fbda-13a9-4f16-ad25-1525267798ef tempest-VolumesSnapshotsTestJSON-2012677850 None] Created volume successfully. Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-63ccc302-f9eb-45ed-a5ea-75662b7f0133 req-0e6c2eb0-6c6b-4da5-8f54-62df7d9fd534 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-63ccc302-f9eb-45ed-a5ea-75662b7f0133 req-0e6c2eb0-6c6b-4da5-8f54-62df7d9fd534 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-63ccc302-f9eb-45ed-a5ea-75662b7f0133 req-0e6c2eb0-6c6b-4da5-8f54-62df7d9fd534 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-63ccc302-f9eb-45ed-a5ea-75662b7f0133 req-0e6c2eb0-6c6b-4da5-8f54-62df7d9fd534 tempest-AttachVolumeNegativeTest-228869102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-84cf5703-150e-4eaa-a81d-88e6b12eae83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a23df78f-93be-4ece-ab2a-d4d95c9a4276', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:49:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-63ccc302-f9eb-45ed-a5ea-75662b7f0133 req-0e6c2eb0-6c6b-4da5-8f54-62df7d9fd534 tempest-AttachVolumeNegativeTest-228869102 None] attachment_update completed successfully. Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Creating offline snapshot ad811d7e-7412-48db-8141-3d704efecd1d of volume 7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9b2fb-c4b7-40d1-8a42-57832b94c3c4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:40 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e Nov 02 10:49:40 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:40 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e" returned: 0 in 0.590s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:40 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d 1G Nov 02 10:49:40 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:40 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d 1G" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e216529-bb80-49ce-9126-6eb2ab4a478e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:40 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e216529-bb80-49ce-9126-6eb2ab4a478e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d Nov 02 10:49:40 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:41 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e216529-bb80-49ce-9126-6eb2ab4a478e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:41 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d is being set with open permissions: ugo+rw Nov 02 10:49:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:41 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d Nov 02 10:49:41 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:41 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:41 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info Nov 02 10:49:41 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:42 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:42 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info is being set with open permissions: ugo+rw Nov 02 10:49:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:42 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info Nov 02 10:49:42 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:42 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.info" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-d0130aa4-8516-42f9-86b9-a0eeca8b05fb req-6cab0318-c55f-4cc1-a3a3-eb2d9c7be2ea tempest-VolumesSnapshotsTestJSON-2012677850 None] Create snapshot completed successfully Nov 02 10:49:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-7ff4fdea-c84d-42c5-8096-32c31856775d req-71b948d4-f95a-44fa-9097-37dd35f4b1f7 tempest-AttachVolumeNegativeTest-228869102 None] Terminate volume connection completed successfully. Nov 02 10:49:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-7ff4fdea-c84d-42c5-8096-32c31856775d req-71b948d4-f95a-44fa-9097-37dd35f4b1f7 tempest-AttachVolumeNegativeTest-228869102 None] Deleting attachment a23df78f-93be-4ece-ab2a-d4d95c9a4276. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "cinder-ad811d7e-7412-48db-8141-3d704efecd1d-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-ad811d7e-7412-48db-8141-3d704efecd1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "cinder-quobyte-ad811d7e-7412-48db-8141-3d704efecd1d" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-ad811d7e-7412-48db-8141-3d704efecd1d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Deleting offline snapshot ad811d7e-7412-48db-8141-3d704efecd1d of volume 7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] snapshot_file for this snap is: volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c4b057-8444-4ba7-af5d-546f007ce652]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:44 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d Nov 02 10:49:44 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:44 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d" returned: 0 in 0.688s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e216529-bb80-49ce-9126-6eb2ab4a478e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e8c1dd-a63c-4f0d-a96a-51fecaa25bf9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:44 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e Nov 02 10:49:44 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:44 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:45 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d Nov 02 10:49:45 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:45 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:45 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d Nov 02 10:49:45 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:45 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e.ad811d7e-7412-48db-8141-3d704efecd1d" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-ad811d7e-7412-48db-8141-3d704efecd1d" released by "_delete_snapshot" :: held 2.200s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" released by "delete_snapshot" :: held 2.237s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:45 devstack cinder-volume[86783]: WARNING cinder.quota [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:49:45 devstack cinder-volume[86783]: DEBUG cinder.quota [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Created reservations ['699cbed1-6547-42be-8a5a-7cc3e83d4611', '97dd59fc-eb88-45cd-879e-238d7417d923', '1fb22176-8bc5-4b35-b1a6-b021bf32159a', '5b476285-b817-49ca-ac5f-cd9aa9bd417e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Delete snapshot completed successfully. Nov 02 10:49:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-5f035384-02a3-4021-abe4-bfc276818878 req-c5395d65-7a65-4c36-8d19-fd6e2c916c6e tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-ad811d7e-7412-48db-8141-3d704efecd1d-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "cinder-7e216529-bb80-49ce-9126-6eb2ab4a478e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-7e216529-bb80-49ce-9126-6eb2ab4a478e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30d15a-2f88-417f-9f02-121ff85952a7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:47 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e Nov 02 10:49:47 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-84cf5703-150e-4eaa-a81d-88e6b12eae83-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-84cf5703-150e-4eaa-a81d-88e6b12eae83-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-quobyte-84cf5703-150e-4eaa-a81d-88e6b12eae83" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:47 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-84cf5703-150e-4eaa-a81d-88e6b12eae83" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:47 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e Nov 02 10:49:47 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e008ce-ec0c-4306-bec4-e87a00ec4a0d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:47 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 Nov 02 10:49:47 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:47 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7e216529-bb80-49ce-9126-6eb2ab4a478e" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-quobyte-7e216529-bb80-49ce-9126-6eb2ab4a478e" released by "delete_volume" :: held 0.870s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.quota [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Created reservations ['31cb6570-d2a7-47a9-9c5e-33c81ed7101f', '4aba914d-8621-441e-b461-ccb957e01a0d', '8050ef79-3c05-41e2-8ab4-7cc23f8ef867', '99452b42-54c2-4a57-825f-6c6c7bf1590e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:48 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:48 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83 Nov 02 10:49:48 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:48 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84cf5703-150e-4eaa-a81d-88e6b12eae83" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-84cf5703-150e-4eaa-a81d-88e6b12eae83" released by "delete_volume" :: held 0.714s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:48 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.manager [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Deleted volume successfully. Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-502904f3-a703-41f1-aa56-806bf8fab020 req-38fe1655-74e1-4dd7-8b5c-73cc8cbe5c78 tempest-VolumesSnapshotsTestJSON-2012677850 None] Lock "cinder-7e216529-bb80-49ce-9126-6eb2ab4a478e-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Created reservations ['43658944-9412-4a08-9342-311fc8dc91f3', '565bcf6a-ca87-4704-8e87-daab41096d48', 'c9bfa72d-6b4a-4fc3-a6f9-e13254482c18', 'ab6e7432-562a-431b-bd49-f93853102287'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:48 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:48 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:48 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Deleted volume successfully. Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3469353d-b0d0-4b8b-8a81-2d9ac3b7605c tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-84cf5703-150e-4eaa-a81d-88e6b12eae83-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-43635f4b-1793-47bb-bd37-68df3a21ae0e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-43635f4b-1793-47bb-bd37-68df3a21ae0e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-quobyte-43635f4b-1793-47bb-bd37-68df3a21ae0e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-43635f4b-1793-47bb-bd37-68df3a21ae0e" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c008f-01cf-459b-9b19-28bb3648a95d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:49 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e Nov 02 10:49:49 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:49 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:49 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e Nov 02 10:49:49 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:49 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43635f4b-1793-47bb-bd37-68df3a21ae0e" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-43635f4b-1793-47bb-bd37-68df3a21ae0e" released by "delete_volume" :: held 0.760s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Created reservations ['22f4f985-386b-4b62-99e7-a6b34ff4ff70', 'e027da41-bd2b-4143-9a33-17c99568757e', 'dca2a322-31c0-4c82-82fb-7b0629a0f9ea', 'b5825fc9-7a51-4fc7-8e8a-c3fe3502f2c5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:49 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:49 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:50 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Deleted volume successfully. Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9940681-a1d3-4d21-8c18-d3e490c87418 tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-43635f4b-1793-47bb-bd37-68df3a21ae0e-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-a9fe719c-2966-4533-9e6d-13eb035937dc-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-a9fe719c-2966-4533-9e6d-13eb035937dc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "cinder-quobyte-a9fe719c-2966-4533-9e6d-13eb035937dc" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-a9fe719c-2966-4533-9e6d-13eb035937dc" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[19674f02-2a7f-4142-aafb-9b87745707a6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:50 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc Nov 02 10:49:50 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:50 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:51 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc Nov 02 10:49:51 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:51 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a9fe719c-2966-4533-9e6d-13eb035937dc" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-quobyte-a9fe719c-2966-4533-9e6d-13eb035937dc" released by "delete_volume" :: held 0.750s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Created reservations ['e03c99d9-239b-4b7a-848f-971c3a92702d', '84c2424a-320e-4f3d-a600-a7a29e77eed8', 'db4d080b-f0fa-4803-a5f1-381e365d20e7', '96732ae4-bae4-4865-a918-8a9cb0011877'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:51 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:51 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:51 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Deleted volume successfully. Nov 02 10:49:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c6952988-85fa-4d9a-a041-ace6701c46cf tempest-AttachVolumeNegativeTest-228869102 None] Lock "cinder-a9fe719c-2966-4533-9e6d-13eb035937dc-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Flow 'volume_create_manager' (17223f1a-f603-4121-85e1-055b4430187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319e726a-788a-4984-b014-a5ec66e40eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319e726a-788a-4984-b014-a5ec66e40eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-591224159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b679e455-4470-45e8-b5d8-b889e71527ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0c3615667c44f85b10f295882dbb461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:53Z,use_quota=True,user_id='a12c0b76337e402fb78f70c938f9f108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90112403-90c2-4350-a244-eb382da3d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90112403-90c2-4350-a244-eb382da3d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915a395a-52d7-4c25-98c4-7b81c0377464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915a395a-52d7-4c25-98c4-7b81c0377464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b679e455-4470-45e8-b5d8-b889e71527ad', 'volume_name': 'volume-b679e455-4470-45e8-b5d8-b889e71527ad', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992bf256-3745-40dc-b5f9-42cecbd13fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992bf256-3745-40dc-b5f9-42cecbd13fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f933961-1257-4a18-a626-c3e000950817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Volume b679e455-4470-45e8-b5d8-b889e71527ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b679e455-4470-45e8-b5d8-b889e71527ad', 'volume_size': 1} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-591224159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b679e455-4470-45e8-b5d8-b889e71527ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0c3615667c44f85b10f295882dbb461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:53Z,use_quota=True,user_id='a12c0b76337e402fb78f70c938f9f108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Creating volume b679e455-4470-45e8-b5d8-b889e71527ad {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:49:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:52 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad 1073741824 Nov 02 10:49:52 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:53 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad 1073741824" returned: 0 in 0.543s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:53 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad Nov 02 10:49:53 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:53 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f933961-1257-4a18-a626-c3e000950817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b679e455-4470-45e8-b5d8-b889e71527ad', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84935a41-dc9e-43b4-bc96-4d6bac8b191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Volume volume-b679e455-4470-45e8-b5d8-b889e71527ad (b679e455-4470-45e8-b5d8-b889e71527ad): created successfully Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84935a41-dc9e-43b4-bc96-4d6bac8b191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Flow 'volume_create_manager' (17223f1a-f603-4121-85e1-055b4430187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ee85278b-c0a9-4dc1-9f3d-e6bb81c6c66b req-49422e09-9c64-4d5b-9829-f03796ed894a tempest-VolumesGetTestJSON-1832213447 None] Created volume successfully. Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (3dc4f413-1f8b-42eb-90b0-ff3ff032aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd211bed-b6b7-4bb4-b5a5-f5c3587fe06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd211bed-b6b7-4bb4-b5a5-f5c3587fe06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193129310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9364bcb1-5625-4a04-b5b3-8997a83e3b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:54Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50040ac-7c3d-4cd1-bcff-5328437343cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50040ac-7c3d-4cd1-bcff-5328437343cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b16e7e5-852b-44ae-95c8-e99ac7911f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b16e7e5-852b-44ae-95c8-e99ac7911f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9364bcb1-5625-4a04-b5b3-8997a83e3b18', 'volume_name': 'volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31156bd-97e5-4c3c-8677-c30f86c9e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31156bd-97e5-4c3c-8677-c30f86c9e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f193a52-5946-4aea-9e7f-3396dd767363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Volume 9364bcb1-5625-4a04-b5b3-8997a83e3b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18', 'volume_size': 1} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1193129310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9364bcb1-5625-4a04-b5b3-8997a83e3b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:49:54Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Creating volume 9364bcb1-5625-4a04-b5b3-8997a83e3b18 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:49:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:54 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 1073741824 Nov 02 10:49:54 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:54 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 1073741824" returned: 0 in 0.511s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:54 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 Nov 02 10:49:54 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:54 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f193a52-5946-4aea-9e7f-3396dd767363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e396c5ba-57e1-43c3-ab53-03a10532c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:49:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Volume volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 (9364bcb1-5625-4a04-b5b3-8997a83e3b18): created successfully Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e396c5ba-57e1-43c3-ab53-03a10532c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:49:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (3dc4f413-1f8b-42eb-90b0-ff3ff032aa20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:49:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c7cc1f23-25f1-4bf3-a9be-48c41d686b72 tempest-AttachVolumeTestJSON-1690980648 None] Created volume successfully. Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Acquiring lock "cinder-b679e455-4470-45e8-b5d8-b889e71527ad-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "cinder-b679e455-4470-45e8-b5d8-b889e71527ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Acquiring lock "cinder-quobyte-b679e455-4470-45e8-b5d8-b889e71527ad" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "cinder-quobyte-b679e455-4470-45e8-b5d8-b889e71527ad" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bf53b-7c21-4b9a-a085-d09ba3efd60f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:55 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad Nov 02 10:49:55 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:55 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:55 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad Nov 02 10:49:55 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:56 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b679e455-4470-45e8-b5d8-b889e71527ad" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "cinder-quobyte-b679e455-4470-45e8-b5d8-b889e71527ad" released by "delete_volume" :: held 0.925s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.quota [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Created reservations ['a9954ca4-f207-4419-b22f-d949471724ca', '62bc74a2-94f4-42fa-9fc3-a0936b227133', '448c0758-7768-42ae-9d83-f870cc486f8e', 'b7e76210-0698-4971-aaad-785e5fed3ca0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:49:56 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:49:56 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:49:56 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.manager [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:49:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Deleted volume successfully. Nov 02 10:49:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-f925b3bf-e1b3-43b9-9fae-803927ac1b08 req-4c9f8232-f606-4a7e-a844-6d3f723381ed tempest-VolumesGetTestJSON-1832213447 None] Lock "cinder-b679e455-4470-45e8-b5d8-b889e71527ad-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:49:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f85d1c-855b-49ee-a9a4-8d448a0cfd6b req-07ca1209-ccc2-449f-8852-4d50e8eca8d5 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:49:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f85d1c-855b-49ee-a9a4-8d448a0cfd6b req-07ca1209-ccc2-449f-8852-4d50e8eca8d5 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:49:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f85d1c-855b-49ee-a9a4-8d448a0cfd6b req-07ca1209-ccc2-449f-8852-4d50e8eca8d5 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:49:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-d2f85d1c-855b-49ee-a9a4-8d448a0cfd6b req-07ca1209-ccc2-449f-8852-4d50e8eca8d5 tempest-AttachVolumeTestJSON-1690980648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15a79105-ff85-4f50-9d39-fc97f9708217', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:49:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-d2f85d1c-855b-49ee-a9a4-8d448a0cfd6b req-07ca1209-ccc2-449f-8852-4d50e8eca8d5 tempest-AttachVolumeTestJSON-1690980648 None] attachment_update completed successfully. Nov 02 10:50:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-73847e21-7018-4e21-b1e8-c1253cf14128 tempest-ServerActionsTestOtherA-2065570522 None] Terminate volume connection completed successfully. Nov 02 10:50:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-73847e21-7018-4e21-b1e8-c1253cf14128 tempest-ServerActionsTestOtherA-2065570522 None] Deleting attachment 33f7bb08-418b-4445-b3ad-18206e61615a. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "cinder-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "cinder-quobyte-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-quobyte-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[77787036-05f3-4afd-a9ab-297ec1fe015e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:01 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b Nov 02 10:50:01 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:01 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" returned: 0 in 0.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:01 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b Nov 02 10:50:01 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "cinder-f01254f3-e106-45b5-beb4-8a8ddf3867c5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:02 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-f01254f3-e106-45b5-beb4-8a8ddf3867c5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-quobyte-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b" released by "delete_volume" :: held 1.062s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "cinder-quobyte-f01254f3-e106-45b5-beb4-8a8ddf3867c5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-quobyte-f01254f3-e106-45b5-beb4-8a8ddf3867c5" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.quota [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Created reservations ['d01e63c0-e3d8-42c7-a6dc-dc4c69e3a8c3', '55b3c892-a1c0-4663-903c-e920bcf9bde4', '5c680134-77a7-4aab-ab7d-e67af2b1fa75', '2012974f-3142-4872-88fb-e5425e0af559'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[673aa935-7be8-4c89-b442-e5ec6c35cb6e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:02 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:02 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:02 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 Nov 02 10:50:02 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:02 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.manager [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Deleted volume successfully. Nov 02 10:50:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-fcab8135-bb6a-4ee3-818a-7d5fba379d58 req-7b71e308-11bb-46ae-ae79-f100465964c7 tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-a22d22ee-95bb-4d87-8f8f-dd9cec1b595b-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:02 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5" returned: 0 in 0.673s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:03 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5 Nov 02 10:50:03 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:03 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f01254f3-e106-45b5-beb4-8a8ddf3867c5" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-quobyte-f01254f3-e106-45b5-beb4-8a8ddf3867c5" released by "delete_volume" :: held 1.104s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Created reservations ['ded348a8-ae43-41ed-a6ef-3ecef5da35c8', '2fffe284-b0a1-444b-b660-93a0a3d09bd6', 'f26175e5-aaab-4719-946d-ebb8fc7e2c3f', '3c9cb2dc-bb37-4dd2-8087-2f2bd80f3a5f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:03 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:03 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:03 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Deleted volume successfully. Nov 02 10:50:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5bbc0dce-594b-4ea1-b951-34415e595aca tempest-ServerActionsTestOtherA-2065570522 None] Lock "cinder-f01254f3-e106-45b5-beb4-8a8ddf3867c5-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc07fd0b-e4fd-42ee-8aae-d952ed9f49e5 tempest-BackendsCapabilitiesAdminTestsJSON-513765875 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8103370666504, 'free_capacity_gb': 1773.8103370666504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:50:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-359eb9cd-3c56-472b-bd3f-08ff9dca6db9 tempest-BackendsCapabilitiesAdminTestsJSON-513765875 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8103370666504, 'free_capacity_gb': 1773.8103370666504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:09 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:09 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:09 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:50:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:50:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=80,cinder:INSERT=19,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=20,cinder:SELECT=65,cinder:UPDATE=69,cinder:DELETE=7 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:50:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d548fd72-7c2c-4836-a668-30deadcb752c tempest-GroupsV320Test-872614893 None] Group tempest-GroupsV320Test-Group-777938334: creating Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (e1f6a33f-1ac0-4040-8e53-0aba9c6421b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520a695a-bf4d-4627-b250-ed503b9c1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d548fd72-7c2c-4836-a668-30deadcb752c tempest-GroupsV320Test-872614893 None] Group tempest-GroupsV320Test-Group-777938334: created successfully Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520a695a-bf4d-4627-b250-ed503b9c1704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-598771241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a13628c-40d9-43bb-8488-1a0b4692b218,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:21Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9f7570-d14b-4f57-843d-f222f80ad736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9f7570-d14b-4f57-843d-f222f80ad736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ce099-12bb-4c3a-b54d-4b4139f2d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ce099-12bb-4c3a-b54d-4b4139f2d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a13628c-40d9-43bb-8488-1a0b4692b218', 'volume_name': 'volume-6a13628c-40d9-43bb-8488-1a0b4692b218', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05f929-df53-465b-a479-bfe4754d1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05f929-df53-465b-a479-bfe4754d1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692dfe8b-a0ea-419f-8a00-14b816f2035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Volume 6a13628c-40d9-43bb-8488-1a0b4692b218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a13628c-40d9-43bb-8488-1a0b4692b218', 'volume_size': 1} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-598771241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a13628c-40d9-43bb-8488-1a0b4692b218,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:21Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Creating volume 6a13628c-40d9-43bb-8488-1a0b4692b218 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:21 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d548fd72-7c2c-4836-a668-30deadcb752c tempest-GroupsV320Test-872614893 None] Create group completed successfully. Nov 02 10:50:21 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 1073741824 Nov 02 10:50:21 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:21 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 1073741824" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:21 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 Nov 02 10:50:21 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:21 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692dfe8b-a0ea-419f-8a00-14b816f2035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a13628c-40d9-43bb-8488-1a0b4692b218', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93e7b83-eb7f-4fb5-84f7-7821c7743b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Volume volume-6a13628c-40d9-43bb-8488-1a0b4692b218 (6a13628c-40d9-43bb-8488-1a0b4692b218): created successfully Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93e7b83-eb7f-4fb5-84f7-7821c7743b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (e1f6a33f-1ac0-4040-8e53-0aba9c6421b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c62931fa-e070-4657-8fbd-6738098bfa25 tempest-VolumesTestJSON-569548015 None] Created volume successfully. Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Created reservations ['d95ccfaa-8372-4b52-8e0c-8891cde5b96b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:22 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:22 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:22 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:22 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aa2b1b33-ec7a-45ef-81ff-d42807e30ece tempest-GroupsV320Test-872614893 None] Delete group completed successfully. Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (ae15a726-48b3-4a08-afb6-50036bccfb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e440a02f-a33f-4b6c-8df6-601bbb91ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e440a02f-a33f-4b6c-8df6-601bbb91ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666603117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5ad889-c4eb-437d-a3dd-87b5a122bc5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:24Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6912f0-0fc4-4da6-9adb-5cdffc1a8972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6912f0-0fc4-4da6-9adb-5cdffc1a8972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41040832-156c-4064-8b9a-3ed80e522e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41040832-156c-4064-8b9a-3ed80e522e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5ad889-c4eb-437d-a3dd-87b5a122bc5e', 'volume_name': 'volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86e0d5-72ad-47c8-be31-02b49148f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf86e0d5-72ad-47c8-be31-02b49148f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd3c14f-8d89-41dd-8c25-1e868c4f7d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Volume 0e5ad889-c4eb-437d-a3dd-87b5a122bc5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e', 'volume_size': 1} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666603117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5ad889-c4eb-437d-a3dd-87b5a122bc5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:24Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Creating volume 0e5ad889-c4eb-437d-a3dd-87b5a122bc5e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:23 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e 1073741824 Nov 02 10:50:23 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:24 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e 1073741824" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:24 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e Nov 02 10:50:24 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:24 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd3c14f-8d89-41dd-8c25-1e868c4f7d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13287096-ea23-4248-88ac-043d1a958256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Flow 'volume_create_manager' (c6e4e29e-24fe-4b54-a272-8c2af318110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c64d60e-3dc0-4ac5-b2df-16cb02ed7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Volume volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e (0e5ad889-c4eb-437d-a3dd-87b5a122bc5e): created successfully Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13287096-ea23-4248-88ac-043d1a958256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (ae15a726-48b3-4a08-afb6-50036bccfb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c64d60e-3dc0-4ac5-b2df-16cb02ed7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1327156511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146b7b1-764d-472a-ab18-1a8dcb71bbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd964c0ceca476f880481c797308c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:25Z,use_quota=True,user_id='4761d07e81c54ba0b92ff0f6a1de3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfba3883-b82e-4d2b-a7b7-73bb087cf14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfba3883-b82e-4d2b-a7b7-73bb087cf14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c90c71-19a7-4e5f-ab3a-3e37b4c233a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c90c71-19a7-4e5f-ab3a-3e37b4c233a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c146b7b1-764d-472a-ab18-1a8dcb71bbcf', 'volume_name': 'volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae514d00-9fe9-4841-9c80-b6c096f79837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae514d00-9fe9-4841-9c80-b6c096f79837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d931903c-3d66-4866-8a97-1e6f84bec2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume c146b7b1-764d-472a-ab18-1a8dcb71bbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf', 'volume_size': 1} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1327156511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c146b7b1-764d-472a-ab18-1a8dcb71bbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd964c0ceca476f880481c797308c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:25Z,use_quota=True,user_id='4761d07e81c54ba0b92ff0f6a1de3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Creating volume c146b7b1-764d-472a-ab18-1a8dcb71bbcf {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:24 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf 1073741824 Nov 02 10:50:24 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-11257b95-1470-450d-b4e1-fce4b6472eef tempest-VolumesTestJSON-569548015 None] Created volume successfully. Nov 02 10:50:25 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf 1073741824" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:25 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf Nov 02 10:50:25 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:25 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d931903c-3d66-4866-8a97-1e6f84bec2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d0550b-3565-45c0-b9c9-3fac354a9998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf (c146b7b1-764d-472a-ab18-1a8dcb71bbcf): created successfully Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d0550b-3565-45c0-b9c9-3fac354a9998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Flow 'volume_create_manager' (c6e4e29e-24fe-4b54-a272-8c2af318110a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-76b56741-4f10-4347-a0f6-44d872b4f9aa tempest-VolumeQuotasAdminTestJSON-1141864302 None] Created volume successfully. Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (9443d9ce-733c-479f-8cd7-a4bfc5577629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7dbf8f-8662-4459-adda-72416af93c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7dbf8f-8662-4459-adda-72416af93c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639814641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c3f13b-deac-46fb-b9ac-8c885735a0b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:27Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f608ea3e-fa34-4780-8a68-98a6edc54824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f608ea3e-fa34-4780-8a68-98a6edc54824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17256ef0-a11b-420a-9d49-c6dbc6c24433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17256ef0-a11b-420a-9d49-c6dbc6c24433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c3f13b-deac-46fb-b9ac-8c885735a0b7', 'volume_name': 'volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc9dba2-af9a-4399-b488-513b6a7e6d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc9dba2-af9a-4399-b488-513b6a7e6d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9f2a3-2e72-4836-a7ea-b31e6f0257ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Volume 72c3f13b-deac-46fb-b9ac-8c885735a0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7', 'volume_size': 1} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1639814641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c3f13b-deac-46fb-b9ac-8c885735a0b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a384d554c3b4ef3a8dd289eebe3225f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:27Z,use_quota=True,user_id='7bcd156e729f44699b32db201bc8ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Creating volume 72c3f13b-deac-46fb-b9ac-8c885735a0b7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:26 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 1073741824 Nov 02 10:50:26 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "cinder-c146b7b1-764d-472a-ab18-1a8dcb71bbcf-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "cinder-c146b7b1-764d-472a-ab18-1a8dcb71bbcf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "cinder-quobyte-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "cinder-quobyte-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3da1e4-b967-447c-8632-a28cf987e911]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf Nov 02 10:50:27 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 1073741824" returned: 0 in 0.616s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 Nov 02 10:50:27 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:27 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" returned: 0 in 0.524s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf Nov 02 10:50:27 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:27 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9f2a3-2e72-4836-a7ea-b31e6f0257ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:27 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170faed0-3654-4e2c-a379-a3cec92d3ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "cinder-quobyte-c146b7b1-764d-472a-ab18-1a8dcb71bbcf" released by "delete_volume" :: held 0.911s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Volume volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 (72c3f13b-deac-46fb-b9ac-8c885735a0b7): created successfully Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170faed0-3654-4e2c-a379-a3cec92d3ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Flow 'volume_create_manager' (9443d9ce-733c-479f-8cd7-a4bfc5577629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3ef21489-873a-4734-aad4-a9fb16d671e7 tempest-VolumesTestJSON-569548015 None] Created volume successfully. Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Created reservations ['4d93224d-01f2-494a-bacc-706f8d6346f8', 'f2328099-7b06-48a2-bdb6-f8ab4ec909c6', 'f1e905bd-3320-4cff-9db9-5a7039abf180', 'ba21834f-8ca6-4e80-be43-2c8c7f664887'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:27 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:27 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:28 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Deleted volume successfully. Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e37139fc-2f1b-4da1-97a9-2ab80c2dea77 tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "cinder-c146b7b1-764d-472a-ab18-1a8dcb71bbcf-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Flow 'volume_create_manager' (e7054ef9-afe2-47f5-90a5-8354526d2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8843e09b-c477-46ab-bc4a-614470c386c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8843e09b-c477-46ab-bc4a-614470c386c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1044072898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83277eb-8d8f-437a-a5aa-e7d711d55a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd964c0ceca476f880481c797308c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:29Z,use_quota=True,user_id='4761d07e81c54ba0b92ff0f6a1de3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203280bf-91df-4b51-b372-673b13986d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203280bf-91df-4b51-b372-673b13986d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9b2071-684b-42c4-8d6b-35ec59df179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9b2071-684b-42c4-8d6b-35ec59df179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83277eb-8d8f-437a-a5aa-e7d711d55a53', 'volume_name': 'volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c837326b-5f17-481d-9198-5490bae2d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c837326b-5f17-481d-9198-5490bae2d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd98cc6-a241-4948-b1b7-90d78dd6f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume a83277eb-8d8f-437a-a5aa-e7d711d55a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53', 'volume_size': 1} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1044072898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83277eb-8d8f-437a-a5aa-e7d711d55a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd964c0ceca476f880481c797308c28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:29Z,use_quota=True,user_id='4761d07e81c54ba0b92ff0f6a1de3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Creating volume a83277eb-8d8f-437a-a5aa-e7d711d55a53 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:28 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 1073741824 Nov 02 10:50:28 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:29 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 1073741824" returned: 0 in 0.534s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:29 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 Nov 02 10:50:29 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:29 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd98cc6-a241-4948-b1b7-90d78dd6f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771cdba-2a6c-49de-a626-7d4cfb63c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Volume volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 (a83277eb-8d8f-437a-a5aa-e7d711d55a53): created successfully Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d771cdba-2a6c-49de-a626-7d4cfb63c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Flow 'volume_create_manager' (e7054ef9-afe2-47f5-90a5-8354526d2344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a0882d63-ef9a-46bd-9b6f-6d51003a975f tempest-VolumeQuotasAdminTestJSON-1141864302 None] Created volume successfully. Nov 02 10:50:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8761e884-0bce-480a-ac7e-7ed74767e4ca req-17958523-63da-4a6b-8b81-9034e1089240 tempest-AttachVolumeTestJSON-1690980648 None] Terminate volume connection completed successfully. Nov 02 10:50:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8761e884-0bce-480a-ac7e-7ed74767e4ca req-17958523-63da-4a6b-8b81-9034e1089240 tempest-AttachVolumeTestJSON-1690980648 None] Deleting attachment 15a79105-ff85-4f50-9d39-fc97f9708217. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-72c3f13b-deac-46fb-b9ac-8c885735a0b7-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "cinder-72c3f13b-deac-46fb-b9ac-8c885735a0b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-quobyte-72c3f13b-deac-46fb-b9ac-8c885735a0b7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-72c3f13b-deac-46fb-b9ac-8c885735a0b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5eb1d-08ba-4cb8-9c7b-7782e7f11375]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 Nov 02 10:50:30 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7 Nov 02 10:50:30 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Flow 'volume_create_manager' (50f5ceaa-5700-415e-9459-cb6f425c0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228167a2-0f89-44d0-be62-d426d8b094e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228167a2-0f89-44d0-be62-d426d8b094e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1035266225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8042d80-1608-4387-b39c-633cf36543b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847437fc55664ef1bb7a3ef4f9986b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:31Z,use_quota=True,user_id='590a3379d601415b8397187d36bc8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d2281e-35a5-446b-a4cf-1a92eeaa7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d2281e-35a5-446b-a4cf-1a92eeaa7323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54f5a45-61a5-4f02-af75-d6bfe5de977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54f5a45-61a5-4f02-af75-d6bfe5de977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8042d80-1608-4387-b39c-633cf36543b4', 'volume_name': 'volume-f8042d80-1608-4387-b39c-633cf36543b4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c1347e-2255-42c6-89b6-e15d8dc129d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c1347e-2255-42c6-89b6-e15d8dc129d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c33493-0abc-438b-aa87-4b6136cbabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Volume f8042d80-1608-4387-b39c-633cf36543b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8042d80-1608-4387-b39c-633cf36543b4', 'volume_size': 1} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1035266225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8042d80-1608-4387-b39c-633cf36543b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847437fc55664ef1bb7a3ef4f9986b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:31Z,use_quota=True,user_id='590a3379d601415b8397187d36bc8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Creating volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:30 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 1073741824 Nov 02 10:50:30 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:30 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-72c3f13b-deac-46fb-b9ac-8c885735a0b7" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-72c3f13b-deac-46fb-b9ac-8c885735a0b7" released by "delete_volume" :: held 0.839s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Created reservations ['c8a07e92-f816-4382-83b0-d5934fcd5443', 'f830abcd-5d67-4add-89d1-e92a91c78878', '317cf7be-d3ba-4c98-bc2e-293cea0fbb4c', '7f753936-e628-432a-92ab-dc6f6b1eb0e4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:31 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "cinder-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-quobyte-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53206ae-24f0-4788-a6e4-16507e7fd207]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:31 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.341s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Deleted volume successfully. Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f49ca17f-c362-4de9-b163-cb33c81d0374 tempest-VolumesTestJSON-569548015 None] Lock "cinder-72c3f13b-deac-46fb-b9ac-8c885735a0b7-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:31 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 1073741824" returned: 0 in 0.677s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:31 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 Nov 02 10:50:31 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:31 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e Nov 02 10:50:31 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7abe78e5-2f15-4d41-83fb-a628cf0adae4 tempest-VolumeQuotasAdminTestJSON-1459809118 None] Transfer volume completed successfully. Nov 02 10:50:31 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c33493-0abc-438b-aa87-4b6136cbabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8042d80-1608-4387-b39c-633cf36543b4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01100145-3d7d-497c-be55-0734d4c6c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Volume volume-f8042d80-1608-4387-b39c-633cf36543b4 (f8042d80-1608-4387-b39c-633cf36543b4): created successfully Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01100145-3d7d-497c-be55-0734d4c6c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Flow 'volume_create_manager' (50f5ceaa-5700-415e-9459-cb6f425c0390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d6647a8d-df6a-42c5-8af7-64eaecf391f8 tempest-SnapshotsActionsTest-1197298265 None] Created volume successfully. Nov 02 10:50:31 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:31 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e Nov 02 10:50:31 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:32 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e" released by "delete_volume" :: held 0.750s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Acquiring lock "cinder-a83277eb-8d8f-437a-a5aa-e7d711d55a53-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "cinder-a83277eb-8d8f-437a-a5aa-e7d711d55a53-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Created reservations ['56a42024-4425-4f99-b01b-a87327fed337', 'bc30a94a-04c5-4df6-8f23-178fcd8c71b8', '3ce247bb-040e-47c1-ba47-a3a5e6cc6863', '30da9a25-0310-48ba-b560-e35e6132595e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Acquiring lock "cinder-quobyte-a83277eb-8d8f-437a-a5aa-e7d711d55a53" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "cinder-quobyte-a83277eb-8d8f-437a-a5aa-e7d711d55a53" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce461a86-b1d8-4a1f-9528-ab42b33f6c69]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:32 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:32 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:32 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 Nov 02 10:50:32 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-6a13628c-40d9-43bb-8488-1a0b4692b218-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "cinder-6a13628c-40d9-43bb-8488-1a0b4692b218-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Acquiring lock "cinder-quobyte-6a13628c-40d9-43bb-8488-1a0b4692b218" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-6a13628c-40d9-43bb-8488-1a0b4692b218" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:32 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Deleted volume successfully. Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[187349a7-b334-426d-9f77-02dbc3103c5e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9df87ada-b6ec-44bc-bd57-c2ef8a3302c6 tempest-VolumesTestJSON-569548015 None] Lock "cinder-0e5ad889-c4eb-437d-a3dd-87b5a122bc5e-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:32 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 Nov 02 10:50:32 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:32 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53" returned: 0 in 0.616s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:32 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53 Nov 02 10:50:32 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Creating offline snapshot a466bbe7-9c4a-4545-b3bb-32f017f45d30 of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[11011b00-1f01-4703-99e7-bbc547195986]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 Nov 02 10:50:33 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a83277eb-8d8f-437a-a5aa-e7d711d55a53" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218" returned: 0 in 0.500s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "cinder-quobyte-a83277eb-8d8f-437a-a5aa-e7d711d55a53" released by "delete_volume" :: held 1.015s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:33 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218 Nov 02 10:50:33 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Created reservations ['5d143bbd-e817-4680-a360-7752131e4456', '29cad1c7-2c00-4cb0-9b51-8fcaf72e341b', '50a2a3ff-aba7-42c5-a3b4-20eff87c7997', '02f59738-6739-46ba-8a69-431fa3e393c2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:33 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 1G Nov 02 10:50:33 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:33 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a13628c-40d9-43bb-8488-1a0b4692b218" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "cinder-quobyte-6a13628c-40d9-43bb-8488-1a0b4692b218" released by "delete_volume" :: held 0.900s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Created reservations ['fa76b433-d82f-437d-a044-9b4c8e88f2e7', '7fd36823-9fe6-4981-a56b-62a7efb425a0', 'a0093ccb-6dbf-4f8a-a94e-3f1bf9a3fcfc', 'cab30b77-87c1-432d-98f5-f7d0d7c211d1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:33 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Deleted volume successfully. Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5017ef34-33cd-4784-9202-169ae776dc9c tempest-VolumeQuotasAdminTestJSON-1851396471 None] Lock "cinder-a83277eb-8d8f-437a-a5aa-e7d711d55a53-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:33 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:33 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:34 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 1G" returned: 0 in 0.538s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:34 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Deleted volume successfully. Nov 02 10:50:34 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:34 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-da0abdb6-1230-4944-aa31-eeaac3f733a0 tempest-VolumesTestJSON-569548015 None] Lock "cinder-6a13628c-40d9-43bb-8488-1a0b4692b218-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:34 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.568s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:34 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 is being set with open permissions: ugo+rw Nov 02 10:50:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:34 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:34 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:35 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:35 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info Nov 02 10:50:35 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:35 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info" returned: 0 in 0.569s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:35 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info is being set with open permissions: ugo+rw Nov 02 10:50:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:35 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info Nov 02 10:50:35 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:36 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.info" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d4cfd53f-d041-45b1-8ec9-283979e4276b tempest-SnapshotsActionsTest-1197298265 None] Create snapshot completed successfully Nov 02 10:50:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Creating offline snapshot b8c94e8d-3273-49dd-98f2-12120068abea of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ce416-c76d-4489-97b7-f1932f526d84]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:38 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:38 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:39 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:39 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea 1G Nov 02 10:50:39 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:39 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea 1G" returned: 0 in 0.680s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:39 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea Nov 02 10:50:39 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:40 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:40 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea is being set with open permissions: ugo+rw Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:40 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea Nov 02 10:50:40 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:40 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8157c90-7bf4-4a12-a270-0cca6ded3348 tempest-SnapshotsActionsTest-1197298265 None] Create snapshot completed successfully Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-b8c94e8d-3273-49dd-98f2-12120068abea-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-b8c94e8d-3273-49dd-98f2-12120068abea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-b8c94e8d-3273-49dd-98f2-12120068abea" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-b8c94e8d-3273-49dd-98f2-12120068abea" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Deleting offline snapshot b8c94e8d-3273-49dd-98f2-12120068abea of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] snapshot_file for this snap is: volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[454917e3-ffe8-4dd5-b0aa-c495d056ea40]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea Nov 02 10:50:41 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:41 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2297d-fb9b-4e8f-926e-86c734e55b18]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:41 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:41 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:41 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea Nov 02 10:50:41 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-27144324-17db-4bb5-8a1d-38e4f0c75714 tempest-GroupSnapshotsV319Test-1813883847 None] Group tempest-GroupSnapshotsV319Test-Group-1894532283: creating Nov 02 10:50:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-27144324-17db-4bb5-8a1d-38e4f0c75714 tempest-GroupSnapshotsV319Test-1813883847 None] Group tempest-GroupSnapshotsV319Test-Group-1894532283: created successfully Nov 02 10:50:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-27144324-17db-4bb5-8a1d-38e4f0c75714 tempest-GroupSnapshotsV319Test-1813883847 None] Create group completed successfully. Nov 02 10:50:42 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea" returned: 0 in 0.539s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:42 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea Nov 02 10:50:42 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:42 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.b8c94e8d-3273-49dd-98f2-12120068abea" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-b8c94e8d-3273-49dd-98f2-12120068abea" released by "_delete_snapshot" :: held 1.859s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_snapshot" :: held 1.896s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Created reservations ['6a9e92fc-6ed7-42be-b413-53346abef878', '8708e0f3-8886-45bc-9028-c14a359f9693', '98cc1d9d-475e-4e61-abec-22fcb838fc31', '854dd539-2f6e-49f3-8dfa-acf55724bcaf'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Delete snapshot completed successfully. Nov 02 10:50:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fa603e8-7ce4-4289-bd23-8989d0c5cc68 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-b8c94e8d-3273-49dd-98f2-12120068abea-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Creating offline snapshot 1a47bd2a-8a25-486f-88af-8ef1f8e061cb of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f08ffce-73dc-4a45-9a36-8023ba9c3847]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:43 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:43 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:44 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.541s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:44 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb 1G Nov 02 10:50:44 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Flow 'volume_create_manager' (d4fb2a7f-1474-4a1b-9daa-fe02e6b0faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e48f708-0b6d-4717-8433-e5645f8197bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e48f708-0b6d-4717-8433-e5645f8197bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499057083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b643132-77cd-40b5-b4df-165b00fb7654,host='devstack@QuobyteHD#QuobyteHD',id=31b4aecd-8952-431e-9327-d6c0f02eb16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e156a45466af448b8ac0c1e17ddbde41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:44Z,use_quota=True,user_id='40b7b85eb8a7438496cd02f04c59877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50430519-35cd-48aa-8c8d-08a3ff44bf62),volume_type_id=50430519-35cd-48aa-8c8d-08a3ff44bf62)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11861d4-68ad-48f4-86b0-b195b9501bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11861d4-68ad-48f4-86b0-b195b9501bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2110b7c6-cffc-4d3c-ae03-7e4d41787f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2110b7c6-cffc-4d3c-ae03-7e4d41787f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b4aecd-8952-431e-9327-d6c0f02eb16e', 'volume_name': 'volume-31b4aecd-8952-431e-9327-d6c0f02eb16e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d6fc3b-808f-4bb7-a998-a8a7636b6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d6fc3b-808f-4bb7-a998-a8a7636b6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d443d488-a840-40b1-9754-07a6f2f63a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Volume 31b4aecd-8952-431e-9327-d6c0f02eb16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b4aecd-8952-431e-9327-d6c0f02eb16e', 'volume_size': 1} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:44 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb 1G" returned: 0 in 0.754s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:44 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb Nov 02 10:50:44 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb is being set with open permissions: ugo+rw Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb Nov 02 10:50:45 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:45 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b643132-77cd-40b5-b4df-165b00fb7654,created_at=2026-11-02T09:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499057083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b643132-77cd-40b5-b4df-165b00fb7654,host='devstack@QuobyteHD#QuobyteHD',id=31b4aecd-8952-431e-9327-d6c0f02eb16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e156a45466af448b8ac0c1e17ddbde41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:44Z,use_quota=True,user_id='40b7b85eb8a7438496cd02f04c59877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50430519-35cd-48aa-8c8d-08a3ff44bf62),volume_type_id=50430519-35cd-48aa-8c8d-08a3ff44bf62)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Creating volume 31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:45 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:45 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e 1073741824 Nov 02 10:50:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1c01e95b-9b90-4fef-b47e-40030001800e tempest-SnapshotsActionsTest-1197298265 None] Create snapshot completed successfully Nov 02 10:50:45 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Flow 'volume_create_manager' (8c17a03e-a301-4f1b-9461-9ccd117bbcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d1fc4a-9f72-4916-aba5-4a3707aa6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d1fc4a-9f72-4916-aba5-4a3707aa6eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1414252859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b91987b-99d6-4082-bc0a-61a13cbe27ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c95001bd20147e78f3df72775b1688c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:46Z,use_quota=True,user_id='2524b53b0da444899b152f3445020081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0826b-1f2a-4218-9d08-097ad43c7b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d0826b-1f2a-4218-9d08-097ad43c7b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9138b81-3609-48df-a80d-c3665731cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9138b81-3609-48df-a80d-c3665731cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b91987b-99d6-4082-bc0a-61a13cbe27ed', 'volume_name': 'volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab147f-869f-4bbe-9109-a353a4806e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab147f-869f-4bbe-9109-a353a4806e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3569f228-5a4e-4ccf-8602-5223e0b2c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Volume 9b91987b-99d6-4082-bc0a-61a13cbe27ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed', 'volume_size': 1} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:46 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e 1073741824" returned: 0 in 0.592s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e Nov 02 10:50:46 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1414252859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b91987b-99d6-4082-bc0a-61a13cbe27ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c95001bd20147e78f3df72775b1688c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:46Z,use_quota=True,user_id='2524b53b0da444899b152f3445020081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Creating volume 9b91987b-99d6-4082-bc0a-61a13cbe27ed {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d443d488-a840-40b1-9754-07a6f2f63a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b4aecd-8952-431e-9327-d6c0f02eb16e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06961ed1-e4b2-4b22-b2f6-35eb131f57d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:46 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed 1073741824 Nov 02 10:50:46 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Volume volume-31b4aecd-8952-431e-9327-d6c0f02eb16e (31b4aecd-8952-431e-9327-d6c0f02eb16e): created successfully Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06961ed1-e4b2-4b22-b2f6-35eb131f57d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Flow 'volume_create_manager' (d4fb2a7f-1474-4a1b-9daa-fe02e6b0faf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d63d3017-f707-44be-b041-65d4734ac6da tempest-GroupSnapshotsV319Test-1813883847 None] Created volume successfully. Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-1a47bd2a-8a25-486f-88af-8ef1f8e061cb-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-1a47bd2a-8a25-486f-88af-8ef1f8e061cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-1a47bd2a-8a25-486f-88af-8ef1f8e061cb" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-1a47bd2a-8a25-486f-88af-8ef1f8e061cb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Deleting offline snapshot 1a47bd2a-8a25-486f-88af-8ef1f8e061cb of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] snapshot_file for this snap is: volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e062b21-8843-4869-b206-4693d42534b4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed 1073741824" returned: 0 in 0.551s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed Nov 02 10:50:47 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:47 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb Nov 02 10:50:47 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:47 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] GroupSnapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: creating. Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb" returned: 0 in 0.544s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:47 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[78581275-0721-49f6-9677-d98eb82419fa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3569f228-5a4e-4ccf-8602-5223e0b2c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c54054-7df8-42cd-9bfe-4a5df70424e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Group snapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Volume volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed (9b91987b-99d6-4082-bc0a-61a13cbe27ed): created successfully Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c54054-7df8-42cd-9bfe-4a5df70424e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Flow 'volume_create_manager' (8c17a03e-a301-4f1b-9461-9ccd117bbcab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Creating offline snapshot 39b1133d-0df9-436a-bf5a-f3433468ec4d of volume 31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-526d9f98-874d-4c0e-bdc3-8f6333b0ebee tempest-VolumeQuotasNegativeTestJSON-304849311 None] Created volume successfully. Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6617eae-eba0-43df-bd72-95103a45841e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:47 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:47 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:47 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e Nov 02 10:50:47 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:48 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:48 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb Nov 02 10:50:48 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:48 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:48 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d 1G Nov 02 10:50:48 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:48 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:48 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb Nov 02 10:50:48 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:48 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d 1G" returned: 0 in 0.582s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b4aecd-8952-431e-9327-d6c0f02eb16e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:48 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b4aecd-8952-431e-9327-d6c0f02eb16e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d Nov 02 10:50:48 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.1a47bd2a-8a25-486f-88af-8ef1f8e061cb" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-1a47bd2a-8a25-486f-88af-8ef1f8e061cb" released by "_delete_snapshot" :: held 2.092s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_snapshot" :: held 2.132s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:49 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b4aecd-8952-431e-9327-d6c0f02eb16e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:49 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d Nov 02 10:50:49 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Created reservations ['dfde0a15-24c7-467c-921b-df54cdc9c3d8', 'd3c45dc4-e60d-4a2f-8551-6f8d207f4708', '0295c297-5710-458a-8e22-265342970d7f', 'f8e0236a-4462-42e7-8343-5b697f1e8b91'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Delete snapshot completed successfully. Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ad76f1c-96a0-4636-bab2-f9b987441185 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-1a47bd2a-8a25-486f-88af-8ef1f8e061cb-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:49 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:49 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info Nov 02 10:50:49 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Acquiring lock "cinder-9b91987b-99d6-4082-bc0a-61a13cbe27ed-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "cinder-9b91987b-99d6-4082-bc0a-61a13cbe27ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Acquiring lock "cinder-quobyte-9b91987b-99d6-4082-bc0a-61a13cbe27ed" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "cinder-quobyte-9b91987b-99d6-4082-bc0a-61a13cbe27ed" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14800e5-d2cb-49d7-ba9e-e7cf1efc2f13]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:49 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:49 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:50:49 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:49 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info Nov 02 10:50:49 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:50 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.info" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:50 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:50 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed Nov 02 10:50:50 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff18181b-633b-4ae1-9a5c-f705d617a781 tempest-GroupSnapshotsV319Test-1813883847 None] group_snapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: created successfully Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Creating offline snapshot 227b0d8d-107a-4739-b192-366f6db5102b of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9eb583-7cb8-4688-874c-9f5fa128c00c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:50 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b91987b-99d6-4082-bc0a-61a13cbe27ed" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "cinder-quobyte-9b91987b-99d6-4082-bc0a-61a13cbe27ed" released by "delete_volume" :: held 0.843s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:50 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:50 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Created reservations ['979f2b0a-7b4e-4626-b332-8ea8cedb8dc5', '89de5f52-d0c5-487c-a434-33dd0496961d', '90a77ead-ce8f-4e41-9f30-384ee1b8ff17', '42fdfee2-1e7c-477a-9cc4-833fe4094043'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:50 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:50 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:50 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:51 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b 1G Nov 02 10:50:51 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:51 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Deleted volume successfully. Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a8a40e1-614c-4fd6-8473-0073f0c8e089 tempest-VolumeQuotasNegativeTestJSON-304849311 None] Lock "cinder-9b91987b-99d6-4082-bc0a-61a13cbe27ed-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] group_snapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: deleting Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] group_snapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "cinder-quobyte-39b1133d-0df9-436a-bf5a-f3433468ec4d" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-39b1133d-0df9-436a-bf5a-f3433468ec4d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Deleting offline snapshot 39b1133d-0df9-436a-bf5a-f3433468ec4d of volume 31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] snapshot_file for this snap is: volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d4a324-706a-4a68-98fb-edce0997fc23]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:51 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b 1G" returned: 0 in 0.663s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:51 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b Nov 02 10:50:51 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:51 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d Nov 02 10:50:51 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:51 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:52 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b is being set with open permissions: ugo+rw Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:52 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b Nov 02 10:50:52 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:52 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d" returned: 0 in 0.456s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b4aecd-8952-431e-9327-d6c0f02eb16e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbdccf5-e38f-439e-a36a-4e2fcd94002a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:52 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e Nov 02 10:50:52 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:52 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ac8964d2-e89a-4d7e-84d1-3d5bc1a79899 tempest-SnapshotsActionsTest-1197298265 None] Create snapshot completed successfully Nov 02 10:50:52 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:52 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d Nov 02 10:50:52 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-227b0d8d-107a-4739-b192-366f6db5102b-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-227b0d8d-107a-4739-b192-366f6db5102b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-227b0d8d-107a-4739-b192-366f6db5102b" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-227b0d8d-107a-4739-b192-366f6db5102b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Deleting offline snapshot 227b0d8d-107a-4739-b192-366f6db5102b of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] snapshot_file for this snap is: volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[260629cd-35a4-4f60-88ca-cc1e30cbded9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:52 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b Nov 02 10:50:52 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:53 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:53 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d Nov 02 10:50:53 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:53 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1484f184-3ae5-428b-8c32-413c3d1b0e6b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:53 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e.39b1133d-0df9-436a-bf5a-f3433468ec4d" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-39b1133d-0df9-436a-bf5a-f3433468ec4d" released by "_delete_snapshot" :: held 1.851s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" released by "delete_snapshot" :: held 1.879s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:53 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:53 devstack cinder-volume[86783]: WARNING cinder.quota [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1657042326 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1657042326, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:50:53 devstack cinder-volume[86783]: WARNING cinder.quota [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1657042326 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1657042326, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:50:53 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] Created reservations ['39bedf54-cce9-414a-a5ea-25bc2c7fe06d', 'a7013655-25b5-44a7-afa0-aaa29ab06c15', '8a1b84f1-82c7-42b4-867d-fdce07f22f32', '5054b07f-5b13-4a03-ab65-e43a4fd3ba33'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-00c8ba1f-7ec2-4bdb-aeac-70ce2cfc467d tempest-GroupSnapshotsV319Test-1813883847 None] group_snapshot bef3b82b-4c35-4bad-86d1-0d77f938296b: deleted successfully Nov 02 10:50:53 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:53 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b Nov 02 10:50:53 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1050c9e-7286-4e0a-bb01-664b2a5e4f8d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:54 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b" returned: 0 in 0.499s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:54 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b Nov 02 10:50:54 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:54 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e Nov 02 10:50:54 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:54 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.227b0d8d-107a-4739-b192-366f6db5102b" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-227b0d8d-107a-4739-b192-366f6db5102b" released by "_delete_snapshot" :: held 1.879s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_snapshot" :: held 1.906s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:54 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:54 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e Nov 02 10:50:54 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Created reservations ['b79e9d67-6a49-4445-8e79-dd294d567b06', 'a01619dd-bbee-493c-a798-6d41593350b9', '84d1cef3-1c94-43ec-b2c0-99db34ff6956', '1c90b696-afdd-421b-9d0c-9be3fc952168'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Delete snapshot completed successfully. Nov 02 10:50:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e157402-f8de-4ba2-825c-0a1c206b5bb1 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-227b0d8d-107a-4739-b192-366f6db5102b-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:55 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-31b4aecd-8952-431e-9327-d6c0f02eb16e" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "cinder-quobyte-31b4aecd-8952-431e-9327-d6c0f02eb16e" released by "delete_volume" :: held 0.836s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Created reservations ['7eb56b91-0b33-432c-8d55-27be5e76aaec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:55 devstack cinder-volume[86783]: WARNING cinder.quota [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1657042326 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1657042326, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Created reservations ['c7a2aec0-d6af-4a82-92b8-ac12d909e5e5', 'c16ddda0-3451-4b20-9705-2e321ebfe278', '50a0165f-f403-468e-a067-7ab50374c214', 'bc4f0568-78f1-4680-a4b3-b98cbdebd650'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Creating offline snapshot 16001f54-ef49-49f4-bfc5-1fa8ed504550 of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675a9aa-5a52-42e7-9627-1297a7076341]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:55 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:50:55 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:55 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:55 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:55 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:50:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-df24de2b-26b1-44cc-91df-4ccc16020325 tempest-GroupSnapshotsV319Test-1813883847 None] Delete group completed successfully. Nov 02 10:50:55 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:55 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 1G Nov 02 10:50:55 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:56 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 1G" returned: 0 in 0.592s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:56 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 Nov 02 10:50:56 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:56 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:56 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 is being set with open permissions: ugo+rw Nov 02 10:50:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:56 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 Nov 02 10:50:56 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:57 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550" returned: 0 in 0.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d566e723-152d-4723-ba2c-85a210832bd1 tempest-SnapshotsActionsTest-1197298265 None] Create snapshot completed successfully Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-16001f54-ef49-49f4-bfc5-1fa8ed504550-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-16001f54-ef49-49f4-bfc5-1fa8ed504550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Acquiring lock "cinder-quobyte-16001f54-ef49-49f4-bfc5-1fa8ed504550" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-16001f54-ef49-49f4-bfc5-1fa8ed504550" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Deleting offline snapshot 16001f54-ef49-49f4-bfc5-1fa8ed504550 of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] snapshot_file for this snap is: volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4daf645-5f72-4e95-b9ee-204625fef80b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:57 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 Nov 02 10:50:57 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:58 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9245870-ef1d-40a3-90fd-f4b846e975ca]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:58 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:50:58 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:58 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.565s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:50:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:58 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 Nov 02 10:50:58 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Flow 'volume_create_manager' (0afccb4f-ab04-48e0-997c-5953d4f69112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238be5b9-d511-4fbb-9b90-5f016cb32656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238be5b9-d511-4fbb-9b90-5f016cb32656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1881299201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ae867-6a80-4694-a0b5-0e4670b3c4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4da670da08442388033f8ffa337033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:59Z,use_quota=True,user_id='364dfe8ec6914c5aa6b13b0180fd9204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb67a2d-232f-4901-940b-6fe64a9d1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb67a2d-232f-4901-940b-6fe64a9d1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dbc216-4c9f-44ee-b4d8-33e1de438e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06dbc216-4c9f-44ee-b4d8-33e1de438e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278ae867-6a80-4694-a0b5-0e4670b3c4b2', 'volume_name': 'volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34253d3e-171c-48e7-8e3b-4194180cc763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34253d3e-171c-48e7-8e3b-4194180cc763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fbdf55-6b18-4dd5-b477-dc6206290a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:50:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Volume 278ae867-6a80-4694-a0b5-0e4670b3c4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2', 'volume_size': 1} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1881299201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278ae867-6a80-4694-a0b5-0e4670b3c4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4da670da08442388033f8ffa337033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:50:59Z,use_quota=True,user_id='364dfe8ec6914c5aa6b13b0180fd9204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Creating volume 278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:50:59 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:59 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 1073741824 Nov 02 10:50:59 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:50:59 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550" returned: 0 in 0.912s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:50:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:50:59 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550 Nov 02 10:50:59 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:00 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.16001f54-ef49-49f4-bfc5-1fa8ed504550" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-16001f54-ef49-49f4-bfc5-1fa8ed504550" released by "_delete_snapshot" :: held 2.452s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_snapshot" :: held 2.491s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:00 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 1073741824" returned: 0 in 0.601s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:00 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 Nov 02 10:51:00 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Created reservations ['7f402bdc-25e8-44cd-9b93-656abd0b9a67', '57ce90aa-d1e3-40f1-938d-4dd25e1562d0', 'ab3b28c3-016f-42af-a707-8c7d7220b7aa', 'a7dc5789-302c-4309-85ae-7cee8a66b68f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Delete snapshot completed successfully. Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1756e6ef-191d-4ca4-81ba-eeb897e6e753 tempest-SnapshotsActionsTest-1986503884 None] Lock "cinder-16001f54-ef49-49f4-bfc5-1fa8ed504550-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:00 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fbdf55-6b18-4dd5-b477-dc6206290a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403c3da3-5ea9-4087-9a37-00a1b9a21104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:00 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Volume volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 (278ae867-6a80-4694-a0b5-0e4670b3c4b2): created successfully Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403c3da3-5ea9-4087-9a37-00a1b9a21104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Flow 'volume_create_manager' (0afccb4f-ab04-48e0-997c-5953d4f69112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7d53015a-601f-4391-b7e1-93dcc75f1d14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Created volume successfully. Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "cinder-a466bbe7-9c4a-4545-b3bb-32f017f45d30-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-a466bbe7-9c4a-4545-b3bb-32f017f45d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "cinder-quobyte-a466bbe7-9c4a-4545-b3bb-32f017f45d30" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-a466bbe7-9c4a-4545-b3bb-32f017f45d30" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Deleting offline snapshot a466bbe7-9c4a-4545-b3bb-32f017f45d30 of volume f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] snapshot_file for this snap is: volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242aeec-7f88-4f00-b379-ddcb229b2c2a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Creating offline snapshot 249ebf7e-5902-4953-a346-8799dc9e98cc of volume 278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ef6c6-2bee-4bb0-8db7-6a51394bf14f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:01 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:51:01 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:01 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 Nov 02 10:51:01 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:02 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.563s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8042d80-1608-4387-b39c-633cf36543b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc50bc3-72fa-4c0f-9b61-c0fb27d89ad6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:02 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2" returned: 0 in 0.557s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:02 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc 1G Nov 02 10:51:02 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:02 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 Nov 02 10:51:02 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:02 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:02 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:51:02 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:02 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc 1G" returned: 0 in 0.556s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:02 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc Nov 02 10:51:02 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:03 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:03 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc" returned: 0 in 0.360s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:03 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc is being set with open permissions: ugo+rw Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:03 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30 Nov 02 10:51:03 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:03 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc Nov 02 10:51:03 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:03 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4.a466bbe7-9c4a-4545-b3bb-32f017f45d30" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-a466bbe7-9c4a-4545-b3bb-32f017f45d30" released by "_delete_snapshot" :: held 1.975s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:03 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_snapshot" :: held 2.012s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:03 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info Nov 02 10:51:03 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Created reservations ['bc20f9b3-72c8-448f-81b2-f9fb09cb0991', 'c627d4fd-0464-4a1b-8f63-07d74ec62875', 'd261e396-9f86-4b0e-bc13-f0d52a03c865', '7c0a06a6-5bcb-45ca-9f1f-56f352e71b78'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Delete snapshot completed successfully. Nov 02 10:51:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f3c3b1c-f805-4ba7-8171-7e1f9480922f tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-a466bbe7-9c4a-4545-b3bb-32f017f45d30-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:04 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:04 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info is being set with open permissions: ugo+rw Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:04 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info Nov 02 10:51:04 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-05bab58d-36b6-471f-ad1a-3d54fe915e18 tempest-GroupsV314Test-944028319 None] Group tempest-GroupsV314Test-Group-1732983070: creating Nov 02 10:51:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-05bab58d-36b6-471f-ad1a-3d54fe915e18 tempest-GroupsV314Test-944028319 None] Group tempest-GroupsV314Test-Group-1732983070: created successfully Nov 02 10:51:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-05bab58d-36b6-471f-ad1a-3d54fe915e18 tempest-GroupsV314Test-944028319 None] Create group completed successfully. Nov 02 10:51:04 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.info" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ddc7df4b-e2e7-4e49-82fc-bd6fa9069e92 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Create snapshot completed successfully Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "cinder-f8042d80-1608-4387-b39c-633cf36543b4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-f8042d80-1608-4387-b39c-633cf36543b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e3dcf-b187-47bb-bf03-f9b2a0287b37]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:05 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 Nov 02 10:51:05 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:05 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "cinder-249ebf7e-5902-4953-a346-8799dc9e98cc-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-249ebf7e-5902-4953-a346-8799dc9e98cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:05 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4 Nov 02 10:51:05 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "cinder-quobyte-249ebf7e-5902-4953-a346-8799dc9e98cc" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-249ebf7e-5902-4953-a346-8799dc9e98cc" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Deleting offline snapshot 249ebf7e-5902-4953-a346-8799dc9e98cc of volume 278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] snapshot_file for this snap is: volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[897f905f-36b6-4175-be26-078346b91161]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:05 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:05 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc Nov 02 10:51:05 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f8042d80-1608-4387-b39c-633cf36543b4" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-quobyte-f8042d80-1608-4387-b39c-633cf36543b4" released by "delete_volume" :: held 0.829s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Created reservations ['3bcf9587-8f7a-4dbb-87ed-3e267ac576ac', '6b9af46d-bbef-472f-8099-baab92153f21', '7bdeca63-47b9-4f84-a233-787930e5a91d', 'fc5774b8-ea54-4098-94d4-39606d2fe045'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:05 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:05 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:06 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Flow 'volume_create_manager' (f36dd058-89da-4d2c-ae0a-c7b63cb0f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101262e9-517a-438d-aa03-4be29f571c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc" returned: 0 in 0.641s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101262e9-517a-438d-aa03-4be29f571c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918336486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea29191-3c15-44fb-be32-a78b46e7f564,host='devstack@QuobyteHD#QuobyteHD',id=2790c684-a3fd-4268-8d14-02d76fc16b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1f1aebec9420b907a12773053afe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:06Z,use_quota=True,user_id='ab9286b85b91452a895ad8d93cf0cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21b5f845-7a77-4b06-91ee-44a005f7dce7),volume_type_id=21b5f845-7a77-4b06-91ee-44a005f7dce7)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d44c5-6ba6-433c-a064-eacc9b272f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0d44c5-6ba6-433c-a064-eacc9b272f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8561a655-ccf1-4abb-aa38-6a9c8180c3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8561a655-ccf1-4abb-aa38-6a9c8180c3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2790c684-a3fd-4268-8d14-02d76fc16b77', 'volume_name': 'volume-2790c684-a3fd-4268-8d14-02d76fc16b77', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a52f3-bc31-4df0-80ea-f6d92cee33bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862a52f3-bc31-4df0-80ea-f6d92cee33bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b070598-dc2a-4543-bd47-43a503d3b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Volume 2790c684-a3fd-4268-8d14-02d76fc16b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2790c684-a3fd-4268-8d14-02d76fc16b77', 'volume_size': 1} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aea29191-3c15-44fb-be32-a78b46e7f564,created_at=2026-11-02T09:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918336486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aea29191-3c15-44fb-be32-a78b46e7f564,host='devstack@QuobyteHD#QuobyteHD',id=2790c684-a3fd-4268-8d14-02d76fc16b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1f1aebec9420b907a12773053afe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:06Z,use_quota=True,user_id='ab9286b85b91452a895ad8d93cf0cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21b5f845-7a77-4b06-91ee-44a005f7dce7),volume_type_id=21b5f845-7a77-4b06-91ee-44a005f7dce7)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Creating volume 2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:06 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab7d3d-68be-4f2a-a6e9-ff7eaa8d7c16]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:06 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 1073741824 Nov 02 10:51:06 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:06 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Deleted volume successfully. Nov 02 10:51:06 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 Nov 02 10:51:06 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d9051d6-3f7d-4e4e-9739-562802dc8c57 tempest-SnapshotsActionsTest-1197298265 None] Lock "cinder-f8042d80-1608-4387-b39c-633cf36543b4-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:06 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:06 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc Nov 02 10:51:06 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:06 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 1073741824" returned: 0 in 0.580s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:06 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:06 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:07 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:07 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b070598-dc2a-4543-bd47-43a503d3b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2790c684-a3fd-4268-8d14-02d76fc16b77', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff21b75-3db3-4fab-85c2-04ff2d61a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:07 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc Nov 02 10:51:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Volume volume-2790c684-a3fd-4268-8d14-02d76fc16b77 (2790c684-a3fd-4268-8d14-02d76fc16b77): created successfully Nov 02 10:51:07 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff21b75-3db3-4fab-85c2-04ff2d61a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Flow 'volume_create_manager' (f36dd058-89da-4d2c-ae0a-c7b63cb0f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b43e0ef4-70af-4016-92d3-b9727e8f7cc1 tempest-GroupsV314Test-944028319 None] Created volume successfully. Nov 02 10:51:07 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2.249ebf7e-5902-4953-a346-8799dc9e98cc" returned: 0 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-249ebf7e-5902-4953-a346-8799dc9e98cc" released by "_delete_snapshot" :: held 2.152s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" released by "delete_snapshot" :: held 2.190s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Created reservations ['3149fc2f-9fd9-40d4-855f-379948e74e5b', '61228c0a-4f52-4aa6-90e2-948a3da617c7', '75ec2382-91be-45b6-8733-86c95e40f15b', '87714132-7580-4a89-a603-b63895088e16'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Delete snapshot completed successfully. Nov 02 10:51:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-56430200-da11-45be-9f41-442280486307 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-249ebf7e-5902-4953-a346-8799dc9e98cc-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "cinder-278ae867-6a80-4694-a0b5-0e4670b3c4b2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-278ae867-6a80-4694-a0b5-0e4670b3c4b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[13347596-4c19-4148-a14e-c72708fa956f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:09 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 Nov 02 10:51:09 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:09 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2" returned: 0 in 0.613s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:09 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:09 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:09 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2 Nov 02 10:51:09 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:09 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Cloning volume 2790c684-a3fd-4268-8d14-02d76fc16b77 to volume 5b3e1a8c-1576-480e-8673-53184cdf42b3 Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Creating offline snapshot d1d1a421-9952-4fdb-be19-b67b5d558916 of volume 2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda66b11-3dbc-415a-8941-f7855119ce4c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:09 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:51:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:51:10 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-278ae867-6a80-4694-a0b5-0e4670b3c4b2" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:10 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:10 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-quobyte-278ae867-6a80-4694-a0b5-0e4670b3c4b2" released by "delete_volume" :: held 1.203s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Created reservations ['39009754-bd84-4556-9928-ae5a81b1fccb', 'f7673759-b009-4ed8-8bbb-8f5970a17abe', '8112396f-46d6-4440-8a70-04a3f58fb020', '3f6e90a2-40cb-47ca-9449-87fce6751aa9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:10 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:10 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:10 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.766s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:10 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 1G Nov 02 10:51:10 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:10 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.478s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Deleted volume successfully. Nov 02 10:51:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c60435d7-5fb8-4306-94b5-077fa6699789 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977399010 None] Lock "cinder-278ae867-6a80-4694-a0b5-0e4670b3c4b2-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:11 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 1G" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2790c684-a3fd-4268-8d14-02d76fc16b77 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:11 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2790c684-a3fd-4268-8d14-02d76fc16b77 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:11 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:11 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2790c684-a3fd-4268-8d14-02d76fc16b77 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:11 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:51:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:11 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:11 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:11 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:12 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info Nov 02 10:51:12 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:12 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:12 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info Nov 02 10:51:12 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:12 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.info" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Acquiring lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] snapshot: d1d1a421-9952-4fdb-be19-b67b5d558916, volume: 5b3e1a8c-1576-480e-8673-53184cdf42b3, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c80bd-97a6-49ca-ae4b-bb524cfd536c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:13 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:13 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:13 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.690s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2790c684-a3fd-4268-8d14-02d76fc16b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:51:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f453a70-1f48-4990-ad16-2366c143891a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:13 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:13 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:14 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.579s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:51:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:51:14 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:51:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:14 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 Nov 02 10:51:14 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:22 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=162,cinder:SELECT=146,cinder:INSERT=40,cinder:DELETE=10 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:22 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=141,cinder:UPDATE=156,cinder:DELETE=14,cinder:INSERT=41 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:25 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3" returned: 0 in 11.615s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:25 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77, size 1024.00 MB, duration 11.62 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:51:25 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Converted 1024.00 MB image at 88.15 MB/s Nov 02 10:51:25 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:51:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:25 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 Nov 02 10:51:25 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:26 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" released by "_copy_volume_from_snapshot" :: held 13.276s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Acquiring lock "cinder-quobyte-d1d1a421-9952-4fdb-be19-b67b5d558916" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-d1d1a421-9952-4fdb-be19-b67b5d558916" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Deleting offline snapshot d1d1a421-9952-4fdb-be19-b67b5d558916 of volume 2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] snapshot_file for this snap is: volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa6e01-77df-488d-aef8-bef84a8ed3d6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:26 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:26 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:26 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2790c684-a3fd-4268-8d14-02d76fc16b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5717eab5-8008-4894-a99a-bbe344f48884]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:26 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:26 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:27 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.769s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:27 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:27 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:27 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:27 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916 Nov 02 10:51:27 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:28 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77.d1d1a421-9952-4fdb-be19-b67b5d558916" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-d1d1a421-9952-4fdb-be19-b67b5d558916" released by "_delete_snapshot" :: held 2.209s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.640s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Flow 'volume_create_manager' (6dbc3beb-2f9a-4a63-b122-a0d48c5dd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716d01f5-2d00-47ca-80d9-a9ad54e76868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716d01f5-2d00-47ca-80d9-a9ad54e76868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1612254487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6fa97d-2371-4483-bf15-f5485ef314b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f04ee614c94cfb865311eca0b47e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:28Z,use_quota=True,user_id='0f22eebf3f624b96b834394d170cca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e5a798-b57c-4430-8b92-a7c387fb3819),volume_type_id=d1e5a798-b57c-4430-8b92-a7c387fb3819)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecefb07-ce3d-4cbd-a0d2-71656726ca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecefb07-ce3d-4cbd-a0d2-71656726ca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a0b63-feeb-4511-9766-481ad35af0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a0b63-feeb-4511-9766-481ad35af0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6fa97d-2371-4483-bf15-f5485ef314b9', 'volume_name': 'volume-da6fa97d-2371-4483-bf15-f5485ef314b9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c5859b-62ce-44d5-970f-2be397352ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c5859b-62ce-44d5-970f-2be397352ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3480c57-e553-4596-b0e4-295b4fca6c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Volume da6fa97d-2371-4483-bf15-f5485ef314b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6fa97d-2371-4483-bf15-f5485ef314b9', 'volume_size': 1} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1612254487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6fa97d-2371-4483-bf15-f5485ef314b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f04ee614c94cfb865311eca0b47e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:28Z,use_quota=True,user_id='0f22eebf3f624b96b834394d170cca52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1e5a798-b57c-4430-8b92-a7c387fb3819),volume_type_id=d1e5a798-b57c-4430-8b92-a7c387fb3819)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Creating volume da6fa97d-2371-4483-bf15-f5485ef314b9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:51:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:28 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 1073741824 Nov 02 10:51:28 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-778e1d84-4ad7-418d-86b7-56f27b837645 tempest-GroupsV314Test-944028319 None] Create group from source-group-aea29191-3c15-44fb-be32-a78b46e7f564 completed successfully. Nov 02 10:51:29 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 1073741824" returned: 0 in 0.588s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:29 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 Nov 02 10:51:29 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Acquiring lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a177e95-9bb0-4f0f-ac5a-3473ad7047ab]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:29 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 Nov 02 10:51:29 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:29 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3480c57-e553-4596-b0e4-295b4fca6c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6fa97d-2371-4483-bf15-f5485ef314b9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb84fe97-e46b-4283-bc3d-60723e4af94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Volume volume-da6fa97d-2371-4483-bf15-f5485ef314b9 (da6fa97d-2371-4483-bf15-f5485ef314b9): created successfully Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb84fe97-e46b-4283-bc3d-60723e4af94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Flow 'volume_create_manager' (6dbc3beb-2f9a-4a63-b122-a0d48c5dd041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6144b21-0f0e-4f04-8e52-f2fa7666abac tempest-VolumeTypesAccessTest-374683237 None] Created volume successfully. Nov 02 10:51:29 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:29 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3 Nov 02 10:51:29 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:29 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5b3e1a8c-1576-480e-8673-53184cdf42b3" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-5b3e1a8c-1576-480e-8673-53184cdf42b3" released by "delete_volume" :: held 0.720s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Created reservations ['b98daca9-0b38-4c6f-b51e-3fcda48b71da'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:29 devstack cinder-volume[86783]: WARNING cinder.quota [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1308518368 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1308518368, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:29 devstack cinder-volume[86783]: WARNING cinder.quota [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1308518368 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1308518368, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Created reservations ['445d8e67-0ef1-4afa-a541-a0460515653f', '60d80a48-0a04-4cb1-8b0f-af1966b14bff', '216d719d-1eca-4cfe-943f-b093a0eda0a2', '02e81590-fef8-4ca6-8587-b6a7f3a3b3c0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:30 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:30 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:30 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-126120be-8456-4081-8579-faf432fca28d tempest-GroupsV314Test-944028319 None] Delete group completed successfully. Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Acquiring lock "cinder-da6fa97d-2371-4483-bf15-f5485ef314b9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "cinder-da6fa97d-2371-4483-bf15-f5485ef314b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Acquiring lock "cinder-quobyte-da6fa97d-2371-4483-bf15-f5485ef314b9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "cinder-quobyte-da6fa97d-2371-4483-bf15-f5485ef314b9" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace76215-55fc-479e-8836-b8b9ff8018a4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Acquiring lock "cinder-quobyte-2790c684-a3fd-4268-8d14-02d76fc16b77" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-2790c684-a3fd-4268-8d14-02d76fc16b77" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:51:30 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 Nov 02 10:51:30 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5c1e2-fdb5-448e-96c7-b4d1c1af9f5b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:51:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:30 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:30 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9 Nov 02 10:51:31 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77 Nov 02 10:51:31 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-da6fa97d-2371-4483-bf15-f5485ef314b9" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "cinder-quobyte-da6fa97d-2371-4483-bf15-f5485ef314b9" released by "delete_volume" :: held 0.779s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:31 devstack cinder-volume[86783]: WARNING cinder.quota [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-172189980 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-172189980, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:31 devstack cinder-volume[86783]: WARNING cinder.quota [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-172189980 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-172189980, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Created reservations ['d0f8c20a-8aa1-45b3-b210-845aac0d34c5', '523a2749-2efa-4b0a-a88d-ce939e68bff1', '324c4b67-21ce-4ec7-b102-542c7a2c6578', '638fb942-172e-4c89-baf1-45d0e3b5fd29'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2790c684-a3fd-4268-8d14-02d76fc16b77" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:31 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Lock "cinder-quobyte-2790c684-a3fd-4268-8d14-02d76fc16b77" released by "delete_volume" :: held 0.815s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Created reservations ['4631ac0c-90d5-4b08-b493-f969cde4ff10'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Created reservations ['c4736d30-14a6-4098-b399-1070cfd5a585', '764e1ccc-919f-428c-bcb1-1a3c9e11168f', '3b5c7c5e-4d47-4c00-b69a-cb34428c833f', '1eb5660a-4691-4d3e-acde-b15d46efd701'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:31 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Deleted volume successfully. Nov 02 10:51:31 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:51:31 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db2eefc7-67ca-4add-b9f9-a99fe68415cf tempest-VolumeTypesAccessTest-374683237 None] Lock "cinder-da6fa97d-2371-4483-bf15-f5485ef314b9-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:51:32 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:51:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-afdb13b7-c57d-4c6d-b266-1a1493901ba5 tempest-GroupsV314Test-944028319 None] Delete group completed successfully. Nov 02 10:51:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=38,cinder:SELECT=24,cinder:INSERT=10 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=33,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:51:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (efff357b-2090-4ed1-8f55-72b41b027144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c951bc32-62e5-437a-8b1a-599fce1e3f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c951bc32-62e5-437a-8b1a-599fce1e3f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-822589252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f82850-79dd-4cc1-ae51-8ec2e60e5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:43Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f16696d-34f1-4015-a918-18adf6e57064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f16696d-34f1-4015-a918-18adf6e57064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9004a377-63ab-4e02-939e-46563381a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9004a377-63ab-4e02-939e-46563381a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f82850-79dd-4cc1-ae51-8ec2e60e5c04', 'volume_name': 'volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7e4856-9429-440d-a573-0cce60561289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7e4856-9429-440d-a573-0cce60561289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca971e-16be-46b9-8559-74ba30069e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Volume f7f82850-79dd-4cc1-ae51-8ec2e60e5c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04', 'volume_size': 1} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-822589252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f82850-79dd-4cc1-ae51-8ec2e60e5c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:43Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Creating volume f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:43 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:43 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 1073741824 Nov 02 10:51:43 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:43 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 1073741824" returned: 0 in 0.523s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:43 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 Nov 02 10:51:43 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:43 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:51:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca971e-16be-46b9-8559-74ba30069e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231b48ab-c2c2-48da-9d02-136add14bb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Volume volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 (f7f82850-79dd-4cc1-ae51-8ec2e60e5c04): created successfully Nov 02 10:51:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231b48ab-c2c2-48da-9d02-136add14bb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (efff357b-2090-4ed1-8f55-72b41b027144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5f98a49d-8a8b-41c7-914b-6605a5d70c15 tempest-AttachVolumeTestJSON-1690980648 None] Created volume successfully. Nov 02 10:51:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0fb4fc9-23f8-4409-a80e-b821d1b91510 req-d3e4dc40-631f-4693-95b1-0e4e27528bd4 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0fb4fc9-23f8-4409-a80e-b821d1b91510 req-d3e4dc40-631f-4693-95b1-0e4e27528bd4 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c0fb4fc9-23f8-4409-a80e-b821d1b91510 req-d3e4dc40-631f-4693-95b1-0e4e27528bd4 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c0fb4fc9-23f8-4409-a80e-b821d1b91510 req-d3e4dc40-631f-4693-95b1-0e4e27528bd4 tempest-AttachVolumeTestJSON-1690980648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e09dadce-1891-4e4a-afde-b9d25127847d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c0fb4fc9-23f8-4409-a80e-b821d1b91510 req-d3e4dc40-631f-4693-95b1-0e4e27528bd4 tempest-AttachVolumeTestJSON-1690980648 None] attachment_update completed successfully. Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (61964f74-1f50-48b4-9e2f-56affe5fddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6a4c2-3fd4-44e9-8015-1c09ee3f9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc6a4c2-3fd4-44e9-8015-1c09ee3f9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028430406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f11782-be6f-45d9-a345-550816d50695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:50Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0cea18-e7dc-444d-bc93-81bf4f28bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0cea18-e7dc-444d-bc93-81bf4f28bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca22263-cfb6-48f9-aaee-3dc4db0dd506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca22263-cfb6-48f9-aaee-3dc4db0dd506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f11782-be6f-45d9-a345-550816d50695', 'volume_name': 'volume-84f11782-be6f-45d9-a345-550816d50695', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a581cff-40ed-46c8-a845-522751ecae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a581cff-40ed-46c8-a845-522751ecae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4422b67a-9e5e-4c3d-a002-373d5806ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Volume 84f11782-be6f-45d9-a345-550816d50695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f11782-be6f-45d9-a345-550816d50695', 'volume_size': 1} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2028430406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f11782-be6f-45d9-a345-550816d50695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e31a52fdf24ce082f21a85d8c75e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:51:50Z,use_quota=True,user_id='18456be4d7b348f295721a53963a34c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Creating volume 84f11782-be6f-45d9-a345-550816d50695 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:51:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:50 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 1073741824 Nov 02 10:51:50 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:50 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 1073741824" returned: 0 in 0.677s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:51:51 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 Nov 02 10:51:51 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:51:51 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4422b67a-9e5e-4c3d-a002-373d5806ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f11782-be6f-45d9-a345-550816d50695', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593b8373-3351-490a-b730-8fd197ba120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:51:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Volume volume-84f11782-be6f-45d9-a345-550816d50695 (84f11782-be6f-45d9-a345-550816d50695): created successfully Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593b8373-3351-490a-b730-8fd197ba120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:51:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Flow 'volume_create_manager' (61964f74-1f50-48b4-9e2f-56affe5fddbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:51:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7033dc3b-60ff-4349-9a74-8d7b0895ef65 tempest-AttachVolumeTestJSON-1690980648 None] Created volume successfully. Nov 02 10:51:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-61d49f88-d7e8-4dbd-8f85-eafea7a90d5a req-6d058ee5-659f-4c53-a386-4cafc2e6422d tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:51:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-61d49f88-d7e8-4dbd-8f85-eafea7a90d5a req-6d058ee5-659f-4c53-a386-4cafc2e6422d tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:51:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-61d49f88-d7e8-4dbd-8f85-eafea7a90d5a req-6d058ee5-659f-4c53-a386-4cafc2e6422d tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:51:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-61d49f88-d7e8-4dbd-8f85-eafea7a90d5a req-6d058ee5-659f-4c53-a386-4cafc2e6422d tempest-AttachVolumeTestJSON-1690980648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-84f11782-be6f-45d9-a345-550816d50695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22412513-ade0-4768-8280-97a7968f38e6', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:51:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-61d49f88-d7e8-4dbd-8f85-eafea7a90d5a req-6d058ee5-659f-4c53-a386-4cafc2e6422d tempest-AttachVolumeTestJSON-1690980648 None] attachment_update completed successfully. Nov 02 10:51:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-5d63145d-0806-4aae-b206-6d0cfdbaf726 req-4eaec3a8-7678-4626-ac7a-952414ae2a2a tempest-AttachVolumeTestJSON-1690980648 None] Terminate volume connection completed successfully. Nov 02 10:51:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-5d63145d-0806-4aae-b206-6d0cfdbaf726 req-4eaec3a8-7678-4626-ac7a-952414ae2a2a tempest-AttachVolumeTestJSON-1690980648 None] Deleting attachment e09dadce-1891-4e4a-afde-b9d25127847d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:51:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-6283ef7b-6ff3-46e5-8cf3-9e5fbd8371c1 req-e09bc86b-9305-48e2-9ee4-56755b9d8050 tempest-AttachVolumeTestJSON-1690980648 None] Terminate volume connection completed successfully. Nov 02 10:51:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-6283ef7b-6ff3-46e5-8cf3-9e5fbd8371c1 req-e09bc86b-9305-48e2-9ee4-56755b9d8050 tempest-AttachVolumeTestJSON-1690980648 None] Deleting attachment 22412513-ade0-4768-8280-97a7968f38e6. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Flow 'volume_create_manager' (fc4c4f2d-f040-4c30-9a78-3c4ba9693273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18dbe98-76ca-4187-a21f-f59a6f5bf441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18dbe98-76ca-4187-a21f-f59a6f5bf441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1401195126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d421c732-509b-4b57-a962-042f8af808fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de12f60a82f24be4acaccffa2e9c845e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:04Z,use_quota=True,user_id='b8f7b8b6e68f4a0c938b1c6f0e87b9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4697cd7f-0c26-4443-94a2-7db981b8caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4697cd7f-0c26-4443-94a2-7db981b8caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa1a4a3-a569-4f2d-81bf-76007140fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:03 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa1a4a3-a569-4f2d-81bf-76007140fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd421c732-509b-4b57-a962-042f8af808fa', 'volume_name': 'volume-d421c732-509b-4b57-a962-042f8af808fa', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2db968-f9f9-4ed6-91ce-b4e46f5d9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2db968-f9f9-4ed6-91ce-b4e46f5d9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a1fb20-c633-4b03-a268-d90e972ff876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Volume d421c732-509b-4b57-a962-042f8af808fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d421c732-509b-4b57-a962-042f8af808fa', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Trying to clone d421c732-509b-4b57-a962-042f8af808fa from image 134ee211-162c-468b-b66a-c0628be004d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-84f11782-be6f-45d9-a345-550816d50695-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-84f11782-be6f-45d9-a345-550816d50695-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-quobyte-84f11782-be6f-45d9-a345-550816d50695" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-84f11782-be6f-45d9-a345-550816d50695" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c6080f-c4a7-4573-98f9-4811faba84ac]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:04 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:52:04 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:52:04 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 Nov 02 10:52:04 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b600c5-783e-499b-9fd6-2c19687f4b7c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:05 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD Nov 02 10:52:05 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:05 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695" returned: 0 in 0.516s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:05 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695 Nov 02 10:52:05 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:05 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 is fetched for user b8f7b8b6e68f4a0c938b1c6f0e87b9d1. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[67168500-b897-4d2b-bd8a-ff40a33efe59]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:05 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD Nov 02 10:52:05 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:05 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84f11782-be6f-45d9-a345-550816d50695" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-84f11782-be6f-45d9-a345-550816d50695" released by "delete_volume" :: held 1.010s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Created reservations ['8c1af351-76ad-4748-bed9-49c3387f73b3', 'a931e28a-99b1-41c7-8827-f7224f77cc22', '2c365c54-e736-4b67-8f64-076365952467', 'd2c28bbc-772c-4ef4-98cc-898e35ccd44e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:05 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1401195126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d421c732-509b-4b57-a962-042f8af808fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de12f60a82f24be4acaccffa2e9c845e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:04Z,use_quota=True,user_id='b8f7b8b6e68f4a0c938b1c6f0e87b9d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Creating volume d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:05 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1073741824 Nov 02 10:52:05 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:06 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:06 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:06 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Deleted volume successfully. Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a60146f7-46ea-4372-acfa-4c86f849e2ca tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-84f11782-be6f-45d9-a345-550816d50695-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:06 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1073741824" returned: 0 in 0.642s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:06 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa Nov 02 10:52:06 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-quobyte-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:07 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5624b1-f974-4528-93c2-8d7407948314]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Attempting download of 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume d421c732-509b-4b57-a962-042f8af808fa. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eba00ac-40b7-4051-bb80-d8036ea2ddae]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 Nov 02 10:52:07 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:07 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh Nov 02 10:52:07 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:07 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04 Nov 02 10:52:07 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:07 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh Nov 02 10:52:07 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:07 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh" returned: 1 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_qwowxhqh' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179bd3d-840d-43e8-93fd-51963ed1d63c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04" released by "delete_volume" :: held 0.928s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Created reservations ['d943d578-1b45-4f7f-b040-55c24000e3f4', '9dcd910b-9144-4a93-b210-f5da09a4c9ca', '8e09e9ec-ca80-421d-b698-61e862b0ba26', 'a3213d67-b5d0-4700-a8bb-9f5d91c6e7d7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:08 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD Nov 02 10:52:08 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:08 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:08 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:08 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] 134ee211-162c-468b-b66a-c0628be004d6 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:08 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa Nov 02 10:52:08 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:08 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Deleted volume successfully. Nov 02 10:52:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d29ad550-3a19-4b19-b3f6-a15d679e6005 tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-f7f82850-79dd-4cc1-ae51-8ec2e60e5c04-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-9364bcb1-5625-4a04-b5b3-8997a83e3b18-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-9364bcb1-5625-4a04-b5b3-8997a83e3b18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "cinder-quobyte-9364bcb1-5625-4a04-b5b3-8997a83e3b18" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-9364bcb1-5625-4a04-b5b3-8997a83e3b18" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6ec53-a4a9-443c-bb05-4ca047fcbebd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:09 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:09 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:09 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 Nov 02 10:52:09 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:09 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.331s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:52:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:52:10 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18" returned: 0 in 0.624s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18 Nov 02 10:52:10 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:10 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9364bcb1-5625-4a04-b5b3-8997a83e3b18" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-quobyte-9364bcb1-5625-4a04-b5b3-8997a83e3b18" released by "delete_volume" :: held 1.064s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Created reservations ['ab90c4c5-4c39-4444-b5d8-47eb2db08b76', 'd5f5c8d5-8cc1-4de7-af1a-de5a29b63f5f', 'fad77d6f-d1c6-4670-bf33-69dd6286ab3e', 'c48d58b9-8545-41f2-8ab9-d0cbc9932c97'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:10 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:10 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa" returned: 0 in 2.691s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_h1l39nf5devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:52:11 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Converted 112.00 MB image at 41.59 MB/s Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Deleted volume successfully. Nov 02 10:52:11 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1G Nov 02 10:52:11 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eba69ed1-1f53-44a2-89a5-b935b43c50de tempest-AttachVolumeTestJSON-1690980648 None] Lock "cinder-9364bcb1-5625-4a04-b5b3-8997a83e3b18-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:11 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa 1G" returned: 0 in 0.478s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Downloaded image 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume d421c732-509b-4b57-a962-042f8af808fa successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 for user b8f7b8b6e68f4a0c938b1c6f0e87b9d1 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Marking volume d421c732-509b-4b57-a962-042f8af808fa as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Copying metadata from image 134ee211-162c-468b-b66a-c0628be004d6 to d421c732-509b-4b57-a962-042f8af808fa. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Creating volume glance metadata for volume d421c732-509b-4b57-a962-042f8af808fa backed by image 134ee211-162c-468b-b66a-c0628be004d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a1fb20-c633-4b03-a268-d90e972ff876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d421c732-509b-4b57-a962-042f8af808fa', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccecb80f-fde3-440e-a062-fe8cec42958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Volume volume-d421c732-509b-4b57-a962-042f8af808fa (d421c732-509b-4b57-a962-042f8af808fa): created successfully Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccecb80f-fde3-440e-a062-fe8cec42958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Flow 'volume_create_manager' (fc4c4f2d-f040-4c30-9a78-3c4ba9693273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2ad5fe46-f251-45ff-80fd-d3a700fd3e8d tempest-VolumesImageMetadata-698781323 None] Created volume successfully. Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Acquiring lock "cinder-d421c732-509b-4b57-a962-042f8af808fa-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "cinder-d421c732-509b-4b57-a962-042f8af808fa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Acquiring lock "cinder-quobyte-d421c732-509b-4b57-a962-042f8af808fa" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "cinder-quobyte-d421c732-509b-4b57-a962-042f8af808fa" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc7718-58d7-4ebb-add1-414fd96ceeb3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:13 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa Nov 02 10:52:13 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:14 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:14 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa Nov 02 10:52:14 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:14 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d421c732-509b-4b57-a962-042f8af808fa" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "cinder-quobyte-d421c732-509b-4b57-a962-042f8af808fa" released by "delete_volume" :: held 1.148s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Flow 'volume_create_manager' (2a2635fd-9fd2-4867-883b-5409f3412313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db18d32b-eed1-4b08-893d-025634cc6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db18d32b-eed1-4b08-893d-025634cc6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-837784325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177e48da-3f1f-4175-8c22-1de396e57a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22529dbbe574672a0369ebce984efaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:15Z,use_quota=True,user_id='1c46586662b74fa5bbfae475645a8cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17b3b9a-1745-41af-a8f9-b558ab3a6e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17b3b9a-1745-41af-a8f9-b558ab3a6e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb21e45-4242-4778-aca2-45ff456f27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb21e45-4242-4778-aca2-45ff456f27fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177e48da-3f1f-4175-8c22-1de396e57a6d', 'volume_name': 'volume-177e48da-3f1f-4175-8c22-1de396e57a6d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e795fd-8b38-4a43-b52d-83648687f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e795fd-8b38-4a43-b52d-83648687f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6731f3cc-4ab3-4eae-8318-8125a7fc3851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Volume 177e48da-3f1f-4175-8c22-1de396e57a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177e48da-3f1f-4175-8c22-1de396e57a6d', 'volume_size': 1} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-837784325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177e48da-3f1f-4175-8c22-1de396e57a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22529dbbe574672a0369ebce984efaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:15Z,use_quota=True,user_id='1c46586662b74fa5bbfae475645a8cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Creating volume 177e48da-3f1f-4175-8c22-1de396e57a6d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:14 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d 1073741824 Nov 02 10:52:14 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Created reservations ['a0c7acd9-05ed-40c6-ac47-0f662b560b4a', '95e88a3e-e981-451d-a397-89878cc17fbc', '204e20d3-c918-4974-8050-c97dfcb62227', '4e38242f-84c1-4ebe-ad9c-be0af0972c8d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:15 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:15 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:15 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d 1073741824" returned: 0 in 0.825s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:15 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.631s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:15 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d Nov 02 10:52:15 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Deleted volume successfully. Nov 02 10:52:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-651ac295-4239-42da-828f-6df5739458a5 tempest-VolumesImageMetadata-698781323 None] Lock "cinder-d421c732-509b-4b57-a962-042f8af808fa-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:16 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d" returned: 0 in 0.417s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6731f3cc-4ab3-4eae-8318-8125a7fc3851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177e48da-3f1f-4175-8c22-1de396e57a6d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0484f61a-e1f3-4039-b789-cebdcba90393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Volume volume-177e48da-3f1f-4175-8c22-1de396e57a6d (177e48da-3f1f-4175-8c22-1de396e57a6d): created successfully Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0484f61a-e1f3-4039-b789-cebdcba90393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Flow 'volume_create_manager' (2a2635fd-9fd2-4867-883b-5409f3412313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d2a4697d-c9dc-40c7-8457-00191de6f84c tempest-AbsoluteLimitsTests-1759198223 None] Created volume successfully. Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Acquiring lock "cinder-177e48da-3f1f-4175-8c22-1de396e57a6d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "cinder-177e48da-3f1f-4175-8c22-1de396e57a6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Acquiring lock "cinder-quobyte-177e48da-3f1f-4175-8c22-1de396e57a6d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "cinder-quobyte-177e48da-3f1f-4175-8c22-1de396e57a6d" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d2142-19fd-4d95-869e-ec5a3d1f8943]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:17 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d Nov 02 10:52:17 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:18 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d" returned: 0 in 0.709s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:18 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d Nov 02 10:52:18 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:18 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-177e48da-3f1f-4175-8c22-1de396e57a6d" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "cinder-quobyte-177e48da-3f1f-4175-8c22-1de396e57a6d" released by "delete_volume" :: held 1.268s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Created reservations ['ce17aee5-f206-4877-8176-829e1168de6e', 'cb3451f9-0269-4681-b626-571c41e000c6', '99110c41-c220-4ebe-a57b-befff85f762d', '95ac5b4b-5219-4ad9-a2d6-00b530b644da'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:19 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:19 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:19 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.613s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Deleted volume successfully. Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a7d60e97-a34a-44f3-be76-acd4eb8b1c4d tempest-AbsoluteLimitsTests-1759198223 None] Lock "cinder-177e48da-3f1f-4175-8c22-1de396e57a6d-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (9ac4eb34-409c-4ffc-a4bf-262065522390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b151017e-d248-4f1e-8991-dd58e083a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b151017e-d248-4f1e-8991-dd58e083a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1395846397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:20Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbd4a0-7503-498f-a37e-ac9fc8ddf6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bbd4a0-7503-498f-a37e-ac9fc8ddf6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e7bb2a-a378-4d45-b8f7-9ede97337ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e7bb2a-a378-4d45-b8f7-9ede97337ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2', 'volume_name': 'volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7b4ce7-7cbf-400f-aa5f-fefcf1876bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7b4ce7-7cbf-400f-aa5f-fefcf1876bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce6125b-4f67-40dc-b4d1-5688c01cb078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Volume 6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2', 'volume_size': 1} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1395846397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:20Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Creating volume 6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:20 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:20 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 1073741824 Nov 02 10:52:20 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:20 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 1073741824" returned: 0 in 0.557s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:20 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 Nov 02 10:52:20 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:21 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce6125b-4f67-40dc-b4d1-5688c01cb078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bac839-3ef0-451c-ae8a-79fc1de802de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Volume volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 (6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2): created successfully Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bac839-3ef0-451c-ae8a-79fc1de802de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (9ac4eb34-409c-4ffc-a4bf-262065522390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-63e1d125-4d64-4bb0-9ab2-8ed0d76e4539 tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6560efc8-d26a-4658-af5f-442731217068 tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6560efc8-d26a-4658-af5f-442731217068 tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" acquired by "attach_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6560efc8-d26a-4658-af5f-442731217068 tempest-VolumesActionsTest-1699828421 None] Attaching volume 6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 to instance aaa31d1e-7f81-4133-9801-7b49665f7ed2 at mountpoint /dev/vdb on host None. Nov 02 10:52:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6560efc8-d26a-4658-af5f-442731217068 tempest-VolumesActionsTest-1699828421 None] Attach volume completed successfully. Nov 02 10:52:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6560efc8-d26a-4658-af5f-442731217068 tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" released by "attach_volume" :: held 0.185s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Terminate volume connection completed successfully. Nov 02 10:52:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" acquired by "detach_volume" :: waited 0.112s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Detaching volume 6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 from instance aaa31d1e-7f81-4133-9801-7b49665f7ed2. Nov 02 10:52:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Detach volume completed successfully. Nov 02 10:52:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-90952e17-f449-454e-b276-4bf2179fc4b7 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" released by "detach_volume" :: held 0.259s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1f60545d-9e6c-411a-af86-6ccb7553c876 tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1f60545d-9e6c-411a-af86-6ccb7553c876 tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1f60545d-9e6c-411a-af86-6ccb7553c876 tempest-VolumesActionsTest-1699828421 None] Volume detach called, but volume not attached. Nov 02 10:52:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1f60545d-9e6c-411a-af86-6ccb7553c876 tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-quobyte-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "cinder-quobyte-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd8a853-4996-42b1-90e2-8d6f8e5bb8ff]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:25 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 Nov 02 10:52:25 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:25 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:25 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2 Nov 02 10:52:25 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:26 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" returned: 0 in 0.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "cinder-quobyte-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2" released by "delete_volume" :: held 0.859s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Created reservations ['838bf7b4-b537-40b2-968c-96ff6a6fcd12', '9f7475ca-5223-47d0-99e2-dfca17090534', 'e774a54c-f907-45c6-925b-d3cc99f87d57', 'ce88377e-f939-4bfb-b11f-0b5e732d02a2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:26 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:26 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9bfd9ae7-bfce-419f-9df1-dcef65ec6afc tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-1886493065: creating Nov 02 10:52:26 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Deleted volume successfully. Nov 02 10:52:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9bfd9ae7-bfce-419f-9df1-dcef65ec6afc tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-1886493065: created successfully Nov 02 10:52:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9bfd9ae7-bfce-419f-9df1-dcef65ec6afc tempest-GroupSnapshotsTest-1025716839 None] Create group completed successfully. Nov 02 10:52:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58baaa7b-fdc4-444a-a65c-0fa8eec8420a tempest-VolumesActionsTest-1699828421 None] Lock "cinder-6550b7fc-17a1-4fc2-9dc1-7fc39c319cb2-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Flow 'volume_create_manager' (8de74cf8-3186-4cd0-a4b4-cabde352b672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5902f601-99b1-435f-a640-68b29d27f976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5902f601-99b1-435f-a640-68b29d27f976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1461472317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d5bc70-14be-4437-b4e8-80bc6c91f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c84915f07d4adfb431387c0b478953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:27Z,use_quota=True,user_id='4294ae790e3f4624a7f3c5bd0e0d0975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4efe6dd-f439-436f-ac57-98da93861d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4efe6dd-f439-436f-ac57-98da93861d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fc1ad-9cee-4092-ad8d-f60559fd414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fc1ad-9cee-4092-ad8d-f60559fd414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d5bc70-14be-4437-b4e8-80bc6c91f222', 'volume_name': 'volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb1d6e4-b487-44c6-85d5-b3ac571a4445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb1d6e4-b487-44c6-85d5-b3ac571a4445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79be9c0-b29d-4080-a0a8-c9ea86eaa006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Volume d7d5bc70-14be-4437-b4e8-80bc6c91f222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222', 'volume_size': 1} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1461472317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d5bc70-14be-4437-b4e8-80bc6c91f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c84915f07d4adfb431387c0b478953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:27Z,use_quota=True,user_id='4294ae790e3f4624a7f3c5bd0e0d0975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Creating volume d7d5bc70-14be-4437-b4e8-80bc6c91f222 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:27 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 1073741824 Nov 02 10:52:27 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:27 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 1073741824" returned: 0 in 0.737s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:28 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 Nov 02 10:52:28 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:28 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79be9c0-b29d-4080-a0a8-c9ea86eaa006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0db79a6-008d-45d4-b017-75a8b39dc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Volume volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 (d7d5bc70-14be-4437-b4e8-80bc6c91f222): created successfully Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0db79a6-008d-45d4-b017-75a8b39dc313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Flow 'volume_create_manager' (8de74cf8-3186-4cd0-a4b4-cabde352b672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4f908949-434d-4e78-af81-52ee053bc2ac tempest-VolumesTransfersV355Test-1048819060 None] Created volume successfully. Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (51a05171-a0c2-481d-8b09-0a8505201fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb1b2d2-aee4-4289-8727-9fc8d5752ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb1b2d2-aee4-4289-8727-9fc8d5752ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1634512972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e327106-4dac-40b9-9603-dd2f7f3918cd,host='devstack@QuobyteHD#QuobyteHD',id=6a269de2-5407-45fe-b9e5-417f52b57a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:29Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2c30c0d-a2e6-4d5f-bb34-8f13b205b611),volume_type_id=c2c30c0d-a2e6-4d5f-bb34-8f13b205b611)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d409738-7cc7-476a-8f16-0cd8a2a3a64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d409738-7cc7-476a-8f16-0cd8a2a3a64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d463cd-b132-426d-b8af-e0087d51c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d463cd-b132-426d-b8af-e0087d51c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a269de2-5407-45fe-b9e5-417f52b57a88', 'volume_name': 'volume-6a269de2-5407-45fe-b9e5-417f52b57a88', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23972467-e2b3-44dd-b328-92ad56c37fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23972467-e2b3-44dd-b328-92ad56c37fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318d99fa-f361-47a6-b585-0bc92bffbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Volume 6a269de2-5407-45fe-b9e5-417f52b57a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a269de2-5407-45fe-b9e5-417f52b57a88', 'volume_size': 1} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e327106-4dac-40b9-9603-dd2f7f3918cd,created_at=2026-11-02T09:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1634512972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e327106-4dac-40b9-9603-dd2f7f3918cd,host='devstack@QuobyteHD#QuobyteHD',id=6a269de2-5407-45fe-b9e5-417f52b57a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:29Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2c30c0d-a2e6-4d5f-bb34-8f13b205b611),volume_type_id=c2c30c0d-a2e6-4d5f-bb34-8f13b205b611)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Creating volume 6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:28 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 1073741824 Nov 02 10:52:28 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Flow 'volume_create_manager' (f6c256b3-85a5-46e8-927b-ab09c3b20f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860f2029-edee-4de5-9e51-2342a97606f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860f2029-edee-4de5-9e51-2342a97606f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-408556985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55514b5-a98e-4aef-848c-b44f722ef86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c5e198003f4c03af51039724b696c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:29Z,use_quota=True,user_id='a8d9f696709e48329d5598a6674377ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab069d4e-d732-4afe-8631-4628c3b34064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab069d4e-d732-4afe-8631-4628c3b34064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6189210-5747-4e72-aafc-e1287908d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6189210-5747-4e72-aafc-e1287908d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55514b5-a98e-4aef-848c-b44f722ef86a', 'volume_name': 'volume-c55514b5-a98e-4aef-848c-b44f722ef86a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b1d2ca-ea6f-4f4a-a2b9-b1567b320b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b1d2ca-ea6f-4f4a-a2b9-b1567b320b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957f4f83-62d2-4fa5-8a00-38ee2dbef68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Volume c55514b5-a98e-4aef-848c-b44f722ef86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55514b5-a98e-4aef-848c-b44f722ef86a', 'volume_size': 1} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:29 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 1073741824" returned: 0 in 0.564s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:29 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:29 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:29 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-408556985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55514b5-a98e-4aef-848c-b44f722ef86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2c5e198003f4c03af51039724b696c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:29Z,use_quota=True,user_id='a8d9f696709e48329d5598a6674377ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Creating volume c55514b5-a98e-4aef-848c-b44f722ef86a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:29 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a 1073741824 Nov 02 10:52:29 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318d99fa-f361-47a6-b585-0bc92bffbe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a269de2-5407-45fe-b9e5-417f52b57a88', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5881421f-409f-4a7d-bd55-0d0cb3e1dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Volume volume-6a269de2-5407-45fe-b9e5-417f52b57a88 (6a269de2-5407-45fe-b9e5-417f52b57a88): created successfully Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5881421f-409f-4a7d-bd55-0d0cb3e1dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (51a05171-a0c2-481d-8b09-0a8505201fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b19d49e6-7fb5-491d-912f-e8cf858e4f04 tempest-GroupSnapshotsTest-1025716839 None] Created volume successfully. Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-498c4910-9498-4e4c-94d0-17f8ee9635e3 tempest-VolumesTransfersV355Test-1710666797 None] Transfer volume completed successfully. Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:30 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (9eb83640-5591-4180-acdc-eb999c7e9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa70130-c60f-446c-94f7-ef8dd0f9d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a 1073741824" returned: 0 in 0.644s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa70130-c60f-446c-94f7-ef8dd0f9d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-912010204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665119ea-6035-43df-9346-dc59e7bc7b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:30Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028ecc76-3c42-4f6c-bd1f-0edac5938a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028ecc76-3c42-4f6c-bd1f-0edac5938a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca976f93-c850-46f3-af5a-69798370fe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca976f93-c850-46f3-af5a-69798370fe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665119ea-6035-43df-9346-dc59e7bc7b4d', 'volume_name': 'volume-665119ea-6035-43df-9346-dc59e7bc7b4d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e8bacb-3c93-4ded-87ba-3377fbd39bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e8bacb-3c93-4ded-87ba-3377fbd39bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734e67b-bc1e-4401-9670-c54508dad0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Volume 665119ea-6035-43df-9346-dc59e7bc7b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665119ea-6035-43df-9346-dc59e7bc7b4d', 'volume_size': 1} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:30 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a Nov 02 10:52:30 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] GroupSnapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: creating. Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Group snapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:30 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a" returned: 0 in 0.321s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-912010204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665119ea-6035-43df-9346-dc59e7bc7b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:30Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Creating volume 665119ea-6035-43df-9346-dc59e7bc7b4d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "cinder-d7d5bc70-14be-4437-b4e8-80bc6c91f222-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:30 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d 1073741824 Nov 02 10:52:30 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-d7d5bc70-14be-4437-b4e8-80bc6c91f222-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957f4f83-62d2-4fa5-8a00-38ee2dbef68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55514b5-a98e-4aef-848c-b44f722ef86a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b9f1f1-0372-4952-90c9-8f0ff1f14072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Volume volume-c55514b5-a98e-4aef-848c-b44f722ef86a (c55514b5-a98e-4aef-848c-b44f722ef86a): created successfully Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b9f1f1-0372-4952-90c9-8f0ff1f14072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Flow 'volume_create_manager' (f6c256b3-85a5-46e8-927b-ab09c3b20f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b2d276c1-46fd-444f-aad8-19192b53e8f3 tempest-VolumesMetadataTest-681993629 None] Created volume successfully. Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "cinder-quobyte-d7d5bc70-14be-4437-b4e8-80bc6c91f222" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-quobyte-d7d5bc70-14be-4437-b4e8-80bc6c91f222" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ca5c75-f748-465b-956a-1277672a422a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:31 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 Nov 02 10:52:31 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:31 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d 1073741824" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:31 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d Nov 02 10:52:31 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:31 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:31 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222 Nov 02 10:52:31 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:31 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.928s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4734e67b-bc1e-4401-9670-c54508dad0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665119ea-6035-43df-9346-dc59e7bc7b4d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2158e10c-5819-4045-a99f-97ce72a4b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Creating offline snapshot d1cc70ab-c64d-400f-8c17-49f3d49284d7 of volume 6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:52:31 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Volume volume-665119ea-6035-43df-9346-dc59e7bc7b4d (665119ea-6035-43df-9346-dc59e7bc7b4d): created successfully Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2158e10c-5819-4045-a99f-97ce72a4b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (9eb83640-5591-4180-acdc-eb999c7e9245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[93246f0a-472b-4120-bcc1-dab4d4bbe3b5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d7d5bc70-14be-4437-b4e8-80bc6c91f222" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c30ea67c-72db-4904-bcff-45bdc242124d tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-quobyte-d7d5bc70-14be-4437-b4e8-80bc6c91f222" released by "delete_volume" :: held 0.774s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Created reservations ['b3e21c7e-1b13-43e2-bbe8-55a1cf0a5d76', '388af909-f6d7-401c-8733-dcd4f743c63b', '060e04fb-063f-498e-be10-0d3d18f30d61', 'e708ba91-7773-46b3-b012-844b47d02de5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:31 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:31 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:31 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:31 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:32 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Deleted volume successfully. Nov 02 10:52:32 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.505s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:32 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 1G Nov 02 10:52:32 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e290b91-98e0-44e4-b227-c23a5e3bfe03 tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-d7d5bc70-14be-4437-b4e8-80bc6c91f222-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Acquiring lock "cinder-c55514b5-a98e-4aef-848c-b44f722ef86a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "cinder-c55514b5-a98e-4aef-848c-b44f722ef86a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Acquiring lock "cinder-quobyte-c55514b5-a98e-4aef-848c-b44f722ef86a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "cinder-quobyte-c55514b5-a98e-4aef-848c-b44f722ef86a" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9ce91-245c-4226-afe9-df6922d8e052]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:32 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a Nov 02 10:52:32 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Flow 'volume_create_manager' (688407a0-0951-49ad-976f-736e35540ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4047107-6eed-49be-9044-69672245650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4047107-6eed-49be-9044-69672245650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-464542766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaee4b-dc2b-4ef5-9120-5702d63e6150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c84915f07d4adfb431387c0b478953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:33Z,use_quota=True,user_id='4294ae790e3f4624a7f3c5bd0e0d0975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c57ac4a-9e3c-4cab-910b-3f355ce516ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c57ac4a-9e3c-4cab-910b-3f355ce516ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bbfd81-26d6-42dc-8854-53e710b29922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16bbfd81-26d6-42dc-8854-53e710b29922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4aaee4b-dc2b-4ef5-9120-5702d63e6150', 'volume_name': 'volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2993e4-bd95-4b0f-8a67-112cd324d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2993e4-bd95-4b0f-8a67-112cd324d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ac59a1-a103-47c0-99f0-67a3c778f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Volume b4aaee4b-dc2b-4ef5-9120-5702d63e6150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150', 'volume_size': 1} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:32 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 1G" returned: 0 in 0.598s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a269de2-5407-45fe-b9e5-417f52b57a88 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:32 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a269de2-5407-45fe-b9e5-417f52b57a88 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:32 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-665119ea-6035-43df-9346-dc59e7bc7b4d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "cinder-665119ea-6035-43df-9346-dc59e7bc7b4d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-quobyte-665119ea-6035-43df-9346-dc59e7bc7b4d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:32 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-665119ea-6035-43df-9346-dc59e7bc7b4d" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:32 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a Nov 02 10:52:32 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6252012-c3be-47a5-866e-9af37807293e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d Nov 02 10:52:33 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a269de2-5407-45fe-b9e5-417f52b57a88 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:33 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55514b5-a98e-4aef-848c-b44f722ef86a" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "cinder-quobyte-c55514b5-a98e-4aef-848c-b44f722ef86a" released by "delete_volume" :: held 0.782s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Created reservations ['1a54e910-de07-423b-b800-8e969627ba92', '8000aaf5-2622-49b7-838a-f39dd5534311', '1f370b81-5565-400c-96dd-bd035deb95bf', '4971062f-5eb6-4b25-9a70-d27c8b03388f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:33 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d Nov 02 10:52:33 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info Nov 02 10:52:33 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Deleted volume successfully. Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f01865c-e154-42f9-ba18-c21f00d37a35 tempest-VolumesMetadataTest-681993629 None] Lock "cinder-c55514b5-a98e-4aef-848c-b44f722ef86a-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:33 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-665119ea-6035-43df-9346-dc59e7bc7b4d" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-665119ea-6035-43df-9346-dc59e7bc7b4d" released by "delete_volume" :: held 0.781s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Created reservations ['b93af679-e225-4544-bcf1-4beb60c260da', '1963b339-c84e-4c50-9349-ca8356c5f79f', '550d9bf3-79dc-4157-b41b-09452d693673', 'a90df0d7-2fc2-41e0-823e-aa2939263c73'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:33 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info Nov 02 10:52:33 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:33 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:33 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:34 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.info" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:34 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-464542766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aaee4b-dc2b-4ef5-9120-5702d63e6150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c84915f07d4adfb431387c0b478953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:33Z,use_quota=True,user_id='4294ae790e3f4624a7f3c5bd0e0d0975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Creating volume b4aaee4b-dc2b-4ef5-9120-5702d63e6150 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:34 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 1073741824 Nov 02 10:52:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Deleted volume successfully. Nov 02 10:52:34 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb0e5f23-44f1-4e27-a510-dbbbeffb435d tempest-VolumesActionsTest-2024521986 None] Lock "cinder-665119ea-6035-43df-9346-dc59e7bc7b4d-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-507b2f99-7a2f-4ec7-8434-07a961856521 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: created successfully Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (f47d6d73-127c-40de-9c60-0b087e4386c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132b6c3-6213-4b13-8fad-1f9289517dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132b6c3-6213-4b13-8fad-1f9289517dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1663065937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f3ecf9-814d-45cb-bd39-30378cb47256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:35Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd93a442-aa75-4bf2-8bb5-3a5a7e64e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd93a442-aa75-4bf2-8bb5-3a5a7e64e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3d7f3c-8395-45e9-a61d-dc6df65b20ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3d7f3c-8395-45e9-a61d-dc6df65b20ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f3ecf9-814d-45cb-bd39-30378cb47256', 'volume_name': 'volume-d8f3ecf9-814d-45cb-bd39-30378cb47256', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:34 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7458d4-26ce-4e1c-aaff-b106f643aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7458d4-26ce-4e1c-aaff-b106f643aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5ac6f-41cd-4e7c-97d4-ad9a798468e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Volume d8f3ecf9-814d-45cb-bd39-30378cb47256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f3ecf9-814d-45cb-bd39-30378cb47256', 'volume_size': 1} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 1073741824" returned: 0 in 0.635s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:34 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 Nov 02 10:52:34 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:35 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1663065937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f3ecf9-814d-45cb-bd39-30378cb47256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:35Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Creating volume d8f3ecf9-814d-45cb-bd39-30378cb47256 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ac59a1-a103-47c0-99f0-67a3c778f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:35 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 1073741824 Nov 02 10:52:35 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a03ef-3e7d-4f0d-95ff-53a840c9afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Volume volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 (b4aaee4b-dc2b-4ef5-9120-5702d63e6150): created successfully Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2a03ef-3e7d-4f0d-95ff-53a840c9afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Flow 'volume_create_manager' (688407a0-0951-49ad-976f-736e35540ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e1995492-8ae1-4e6e-8bee-8ce3cddeaffc tempest-VolumesTransfersV355Test-1048819060 None] Created volume successfully. Nov 02 10:52:35 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 1073741824" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:35 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 Nov 02 10:52:35 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:36 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256" returned: 0 in 0.321s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.281s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7-3ef64f72-f8e2-4745-b632-bdb419e322ee" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b5ac6f-41cd-4e7c-97d4-ad9a798468e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f3ecf9-814d-45cb-bd39-30378cb47256', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf18679-0332-4bd4-b9d2-c547f1c5f0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7-3ef64f72-f8e2-4745-b632-bdb419e322ee" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Creating volume 3ef64f72-f8e2-4745-b632-bdb419e322ee from snapshot d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Volume volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 (d8f3ecf9-814d-45cb-bd39-30378cb47256): created successfully Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf18679-0332-4bd4-b9d2-c547f1c5f0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (f47d6d73-127c-40de-9c60-0b087e4386c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] snapshot: d1cc70ab-c64d-400f-8c17-49f3d49284d7, volume: 3ef64f72-f8e2-4745-b632-bdb419e322ee, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:52:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e0766bf1-e996-41eb-baf5-1af6d1be4d6a tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "cinder-b4aaee4b-dc2b-4ef5-9120-5702d63e6150-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390424c-5676-4a85-9712-f692079ca20e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-b4aaee4b-dc2b-4ef5-9120-5702d63e6150-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "cinder-quobyte-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-quobyte-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee68c2-d9ee-4b63-b721-0ae175858d63]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:36 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:36 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:36 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 Nov 02 10:52:36 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:36 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a269de2-5407-45fe-b9e5-417f52b57a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[095f90b3-accc-40c0-8d82-21597ba1db59]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:36 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:36 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150 Nov 02 10:52:36 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:36 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:36 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:37 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-quobyte-b4aaee4b-dc2b-4ef5-9120-5702d63e6150" released by "delete_volume" :: held 0.807s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-d8f3ecf9-814d-45cb-bd39-30378cb47256-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "cinder-d8f3ecf9-814d-45cb-bd39-30378cb47256-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:37 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-quobyte-d8f3ecf9-814d-45cb-bd39-30378cb47256" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:37 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee Nov 02 10:52:37 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Created reservations ['0327d97d-e1c8-4fb4-af48-b475d95805b9', 'e989136d-5c09-4a06-b6fd-d3a5478c7fb1', '4bb042fc-b975-4d44-be14-5d87850786e9', '48778d0d-56c1-4ad1-890c-98dd050af231'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-d8f3ecf9-814d-45cb-bd39-30378cb47256" acquired by "delete_volume" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b2eb9a-98fb-4e53-8422-d826f94b6515]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:37 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 Nov 02 10:52:37 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:37 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:37 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:37 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Deleted volume successfully. Nov 02 10:52:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-caa2f333-af83-440a-8ee3-757a02e9d50e tempest-VolumesTransfersV355Test-1593878906 None] Lock "cinder-b4aaee4b-dc2b-4ef5-9120-5702d63e6150-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:38 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256" returned: 0 in 0.559s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:38 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256 Nov 02 10:52:38 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d8f3ecf9-814d-45cb-bd39-30378cb47256" returned: 0 in 0.666s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:38 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-d8f3ecf9-814d-45cb-bd39-30378cb47256" released by "delete_volume" :: held 1.331s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Created reservations ['dbb36847-d4cc-42aa-9f58-50aa5be47a4a', '4eff6f4b-93d2-40e8-98a1-248f3db9d133', 'cc174b27-5a89-48f7-b571-654cafd24a26', 'bb6bae7d-7527-4dd9-8b64-c807d668fc00'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:39 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:39 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:39 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.709s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Deleted volume successfully. Nov 02 10:52:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8f8429c7-1fe3-43cd-9d28-f0ee9e1c6eac tempest-VolumesActionsTest-2024521986 None] Lock "cinder-d8f3ecf9-814d-45cb-bd39-30378cb47256-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (7987b75e-c119-4719-8683-01ed385c71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0a32c1-41f3-4bda-b9c6-c5108995b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0a32c1-41f3-4bda-b9c6-c5108995b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270766548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95702f9-516b-48d6-8519-37ffa3140989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:41Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e86620-20b2-46ce-b469-8f0d4fcd11e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e86620-20b2-46ce-b469-8f0d4fcd11e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d694cb-df58-408a-b6d5-25adf4024a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d694cb-df58-408a-b6d5-25adf4024a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95702f9-516b-48d6-8519-37ffa3140989', 'volume_name': 'volume-a95702f9-516b-48d6-8519-37ffa3140989', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71581c31-ded6-4a5f-b2cd-1cb113460f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71581c31-ded6-4a5f-b2cd-1cb113460f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b9f58e-6ec5-4b1a-abcd-221d9563681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Volume a95702f9-516b-48d6-8519-37ffa3140989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95702f9-516b-48d6-8519-37ffa3140989', 'volume_size': 1} Nov 02 10:52:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=118,cinder:UPDATE=126,cinder:INSERT=36,cinder:DELETE=12 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=121,cinder:UPDATE=141,cinder:INSERT=35,cinder:DELETE=10 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Flow 'volume_create_manager' (9be49a89-0e8f-4950-8a7b-b9c664cda410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84adcada-f167-4c84-a4f8-3b0c5e5c0b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84adcada-f167-4c84-a4f8-3b0c5e5c0b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-741292837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e01377-7fdb-47fb-99c9-fdc6bb55eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e75fc7530487893ee379dc8a322aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:42Z,use_quota=True,user_id='a46d92887c2e42d1ba3e06d4be16683c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4947194e-c6a1-43bc-b52d-97b2bd7b9b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4947194e-c6a1-43bc-b52d-97b2bd7b9b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f17423-27e2-4bce-8cf1-f4a13202a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f17423-27e2-4bce-8cf1-f4a13202a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e01377-7fdb-47fb-99c9-fdc6bb55eeeb', 'volume_name': 'volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97eaa0b6-c641-4fa8-a54f-ddaef0815d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97eaa0b6-c641-4fa8-a54f-ddaef0815d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b0bf8-a1a9-4108-adaf-f62ab1b41947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Volume 64e01377-7fdb-47fb-99c9-fdc6bb55eeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb', 'volume_size': 1} Nov 02 10:52:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:45 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee" returned: 0 in 8.432s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:45 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:52:45 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Converted 1024.00 MB image at 121.41 MB/s Nov 02 10:52:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:52:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:45 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee Nov 02 10:52:45 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:46 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" released by "_copy_volume_from_snapshot" :: held 9.790s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7-3ef64f72-f8e2-4745-b632-bdb419e322ee" released by "_create_volume_from_snapshot" :: held 9.879s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.920s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.636s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270766548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95702f9-516b-48d6-8519-37ffa3140989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:41Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Creating volume a95702f9-516b-48d6-8519-37ffa3140989 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:46 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 1073741824 Nov 02 10:52:46 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2e32fd01-d68d-48c2-94df-53dc33eaede5 tempest-GroupSnapshotsTest-1025716839 None] Create group from source-snapshot-5e2fcb00-ce11-43ee-b9ec-fe511a7a119e completed successfully. Nov 02 10:52:46 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 1073741824" returned: 0 in 0.515s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:46 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 Nov 02 10:52:46 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:46 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.517s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-741292837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e01377-7fdb-47fb-99c9-fdc6bb55eeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e75fc7530487893ee379dc8a322aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:42Z,use_quota=True,user_id='a46d92887c2e42d1ba3e06d4be16683c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Creating volume 64e01377-7fdb-47fb-99c9-fdc6bb55eeeb {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b9f58e-6ec5-4b1a-abcd-221d9563681a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95702f9-516b-48d6-8519-37ffa3140989', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f918e35f-e335-4e54-a541-575865e7beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:46 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb 1073741824 Nov 02 10:52:46 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Volume volume-a95702f9-516b-48d6-8519-37ffa3140989 (a95702f9-516b-48d6-8519-37ffa3140989): created successfully Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f918e35f-e335-4e54-a541-575865e7beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (7987b75e-c119-4719-8683-01ed385c71b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9ace6b6a-768f-4b82-a0ef-b0914aad380e tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5059d7b4-45a0-49bb-9cb3-c5abcd1b23b3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:47 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee Nov 02 10:52:47 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:47 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb 1073741824" returned: 0 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:47 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb Nov 02 10:52:47 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:47 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee" returned: 0 in 0.430s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:47 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee Nov 02 10:52:47 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:47 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0b0bf8-a1a9-4108-adaf-f62ab1b41947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b996fcd6-a971-48f3-9cd9-3ff43e2be5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Volume volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb (64e01377-7fdb-47fb-99c9-fdc6bb55eeeb): created successfully Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b996fcd6-a971-48f3-9cd9-3ff43e2be5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Flow 'volume_create_manager' (9be49a89-0e8f-4950-8a7b-b9c664cda410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2b69b6f9-12dc-43fc-b753-081693eb6c35 tempest-VolumesTransfersTest-365808711 None] Created volume successfully. Nov 02 10:52:47 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3ef64f72-f8e2-4745-b632-bdb419e322ee" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-a95702f9-516b-48d6-8519-37ffa3140989-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-3ef64f72-f8e2-4745-b632-bdb419e322ee" released by "delete_volume" :: held 0.872s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "cinder-a95702f9-516b-48d6-8519-37ffa3140989-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-quobyte-a95702f9-516b-48d6-8519-37ffa3140989" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['8d61fd09-8e80-4a29-8e56-c66790df1386'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-a95702f9-516b-48d6-8519-37ffa3140989" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22cb793-ea9c-476a-bfd3-b8b1138cc27f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1788741397 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1788741397, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:52:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1788741397 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1788741397, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['1394c3ec-caec-4bb7-99ae-63cc3f68e963', '07e91d38-5f55-4035-bf5e-988048820eea', '0b224382-7191-4eaf-a129-acc8984fea6b', '530c6f93-3227-42f7-98c8-5e204729a215'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:48 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 Nov 02 10:52:48 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:48 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: deleting Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Deleting offline snapshot d1cc70ab-c64d-400f-8c17-49f3d49284d7 of volume 6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] snapshot_file for this snap is: volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f038bb9-7a75-4402-a7cb-ee124c304ac8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989" returned: 0 in 0.530s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:48 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989 Nov 02 10:52:48 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-956929d6-a896-43b7-9436-61c05ea71683 tempest-GroupSnapshotsTest-1025716839 None] Delete group completed successfully. Nov 02 10:52:48 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:48 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:48 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a95702f9-516b-48d6-8519-37ffa3140989" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-a95702f9-516b-48d6-8519-37ffa3140989" released by "delete_volume" :: held 0.953s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Created reservations ['bf28563f-71fa-497d-b068-9bedc286e99c', '52b7d780-d322-4c04-969a-5d9fdd7f9134', '63974ff6-0a68-4989-a31f-3f2c9fea0353', '65e01949-bcdb-46cc-8aa9-c415217c42da'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:49 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:49 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:49 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.702s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a269de2-5407-45fe-b9e5-417f52b57a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2b35f-e045-4bbe-b914-c2f5e5a2637d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:49 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:49 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:49 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Deleted volume successfully. Nov 02 10:52:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d35275c-0ca6-4f4c-96d4-99e8a5e5a83b tempest-VolumesActionsTest-2024521986 None] Lock "cinder-a95702f9-516b-48d6-8519-37ffa3140989-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2f049f43-4b20-4c22-8cec-3aa7086870cb tempest-VolumesTransfersTest-785562184 None] Transfer volume completed successfully. Nov 02 10:52:50 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.676s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:50 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:50 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:50 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.430s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:50 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7 Nov 02 10:52:50 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "cinder-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "cinder-quobyte-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-quobyte-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eea7a5-665a-461d-ba04-2defc9dfe765]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:50 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb Nov 02 10:52:50 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:50 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88.d1cc70ab-c64d-400f-8c17-49f3d49284d7" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-d1cc70ab-c64d-400f-8c17-49f3d49284d7" released by "_delete_snapshot" :: held 2.478s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" released by "delete_snapshot" :: held 2.535s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (86af8d7d-03e6-4f05-b514-b3acc7b353b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e59b0-0526-4366-96eb-94edd433a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e59b0-0526-4366-96eb-94edd433a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081680136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc487af-7c36-4e9c-ab62-f5c49affee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:51Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2a49eb-64d5-4ac0-9893-d7772ae1bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2a49eb-64d5-4ac0-9893-d7772ae1bedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a1dd1-d2ca-48ee-aa97-70a7b48d490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3a1dd1-d2ca-48ee-aa97-70a7b48d490d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc487af-7c36-4e9c-ab62-f5c49affee07', 'volume_name': 'volume-9bc487af-7c36-4e9c-ab62-f5c49affee07', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7917ca-da48-483c-b42c-6ef9b20b8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7917ca-da48-483c-b42c-6ef9b20b8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629612d6-a130-459c-84a2-f4b4e3ced41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Volume 9bc487af-7c36-4e9c-ab62-f5c49affee07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc487af-7c36-4e9c-ab62-f5c49affee07', 'volume_size': 1} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081680136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc487af-7c36-4e9c-ab62-f5c49affee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:51Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Creating volume 9bc487af-7c36-4e9c-ab62-f5c49affee07 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 1073741824 Nov 02 10:52:51 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:51 devstack cinder-volume[86783]: WARNING cinder.quota [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1788741397 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1788741397, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" returned: 0 in 0.643s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['819d0124-f1bc-4b09-86ea-ed5de4f6bc74', '7ed293be-6da9-4261-9078-aeea344081b7', 'ef20e8b1-2e8b-40a7-8dfe-9a844bd134c5', '762e1ea2-5230-4f7c-b756-93e5d45f71dc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:51 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb Nov 02 10:52:51 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-552eb4ab-4d25-4356-9319-3c17c8a89f65 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot 5e2fcb00-ce11-43ee-b9ec-fe511a7a119e: deleted successfully Nov 02 10:52:51 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-quobyte-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb" released by "delete_volume" :: held 0.951s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Created reservations ['75df56a4-5e6f-4f09-a591-c88afe803471', 'aa846eb7-6e06-4c18-a66f-90e955d27b9c', 'aa92a0a8-b24e-4910-b425-5fb93e78a38a', '84c98fb9-6848-45e9-95db-008fba79465b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:51 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:51 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 1073741824" returned: 0 in 0.614s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:51 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 Nov 02 10:52:51 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Deleted volume successfully. Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c9397060-fd64-4dc0-a7b4-45c1a2d1d7fa tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-64e01377-7fdb-47fb-99c9-fdc6bb55eeeb-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:52 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629612d6-a130-459c-84a2-f4b4e3ced41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc487af-7c36-4e9c-ab62-f5c49affee07', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d65cb8-eb20-4e46-9845-18ddb0242a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Volume volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 (9bc487af-7c36-4e9c-ab62-f5c49affee07): created successfully Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d65cb8-eb20-4e46-9845-18ddb0242a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (86af8d7d-03e6-4f05-b514-b3acc7b353b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a61d4ee-d846-4b0d-8b51-daafa18c466a tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1b069-eb21-4429-b09c-6e2e9abf821b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Flow 'volume_create_manager' (f73c505f-d873-45d6-b6f3-48b326957d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e56b5f-2eea-4f53-89a6-fdb3f93bbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e56b5f-2eea-4f53-89a6-fdb3f93bbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1426871496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6508ab-cd81-46fe-a7a6-35e879d0f3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e75fc7530487893ee379dc8a322aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:53Z,use_quota=True,user_id='a46d92887c2e42d1ba3e06d4be16683c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5cc2d7-7403-4f68-90e9-d286ae281b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5cc2d7-7403-4f68-90e9-d286ae281b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d84fe5-f4bf-435f-af54-4010b23c1c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d84fe5-f4bf-435f-af54-4010b23c1c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6508ab-cd81-46fe-a7a6-35e879d0f3a1', 'volume_name': 'volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc7e4d-44a1-4c68-ab92-056edbec72bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc7e4d-44a1-4c68-ab92-056edbec72bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bce698-5ffa-4516-ac9e-d8d3ad5c22de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Volume 3b6508ab-cd81-46fe-a7a6-35e879d0f3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1', 'volume_size': 1} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1426871496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6508ab-cd81-46fe-a7a6-35e879d0f3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='653e75fc7530487893ee379dc8a322aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:53Z,use_quota=True,user_id='a46d92887c2e42d1ba3e06d4be16683c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Creating volume 3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:52 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:52 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:52 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 1073741824 Nov 02 10:52:52 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88 Nov 02 10:52:53 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 1073741824" returned: 0 in 0.565s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-9bc487af-7c36-4e9c-ab62-f5c49affee07-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 Nov 02 10:52:53 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-9bc487af-7c36-4e9c-ab62-f5c49affee07-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:53 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6a269de2-5407-45fe-b9e5-417f52b57a88" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-6a269de2-5407-45fe-b9e5-417f52b57a88" released by "delete_volume" :: held 0.898s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Acquiring lock "cinder-quobyte-9bc487af-7c36-4e9c-ab62-f5c49affee07" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-9bc487af-7c36-4e9c-ab62-f5c49affee07" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['46ab0137-521b-4142-874a-d51a4e3663ee'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff7b94-37ba-4c64-9ede-7d37a6290c5e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack cinder-volume[86783]: WARNING cinder.db.api [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1788741397'] Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['8368a5fa-2307-4589-95a4-944593a18565', 'b5e371cd-6918-4c11-a23c-af70f10c44be', '0a30d51a-ba75-43d9-87ee-ad1c5c1195c3', '4d524564-ad4c-40c7-b07b-c1e5f81608c6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:53 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 Nov 02 10:52:53 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:53 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" returned: 0 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bce698-5ffa-4516-ac9e-d8d3ad5c22de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b971b-10ce-480d-972b-e239e6b5fb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:53 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:53 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Volume volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 (3b6508ab-cd81-46fe-a7a6-35e879d0f3a1): created successfully Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b971b-10ce-480d-972b-e239e6b5fb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Flow 'volume_create_manager' (f73c505f-d873-45d6-b6f3-48b326957d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9f3fcb7c-1552-497d-8c65-d05232ac54e3 tempest-VolumesTransfersTest-365808711 None] Created volume successfully. Nov 02 10:52:54 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07 Nov 02 10:52:54 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-015d01a7-f5bf-4b63-978a-85a5ced32ee8 tempest-GroupSnapshotsTest-1025716839 None] Delete group completed successfully. Nov 02 10:52:54 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9bc487af-7c36-4e9c-ab62-f5c49affee07" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-quobyte-9bc487af-7c36-4e9c-ab62-f5c49affee07" released by "delete_volume" :: held 0.916s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Created reservations ['8179e3ef-0584-42a6-8e09-fd50d6709b48', 'c821403e-1bdb-4950-8ebb-353a3b620b90', '61d6156c-7e81-42f6-87c5-551b20e454a8', '2f08574f-e632-41af-a135-7e0c489a2f83'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:54 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:54 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:54 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Deleted volume successfully. Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-efb05d5d-2abc-48cc-bd7f-4731599439a5 tempest-VolumesActionsTest-2024521986 None] Lock "cinder-9bc487af-7c36-4e9c-ab62-f5c49affee07-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "cinder-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "cinder-quobyte-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-quobyte-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160deb9-ec3b-4ff3-911d-eb463d682e0f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 Nov 02 10:52:55 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2734d419-f487-4eb3-a467-c6fa3c0beb73 tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-704435084: creating Nov 02 10:52:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2734d419-f487-4eb3-a467-c6fa3c0beb73 tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-704435084: created successfully Nov 02 10:52:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2734d419-f487-4eb3-a467-c6fa3c0beb73 tempest-GroupSnapshotsTest-1025716839 None] Create group completed successfully. Nov 02 10:52:55 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:55 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1 Nov 02 10:52:55 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:56 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-quobyte-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1" released by "delete_volume" :: held 0.884s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Created reservations ['5a7e46bb-eb78-46c1-b3e6-48bc8d62b2be', '23c52564-c7e1-4189-8920-bd32560ad638', 'f96d4576-94d4-4813-bb30-2f9040786f99', '18ee1170-7b15-4dd2-8375-52b8365177bd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (d3350d1c-0914-4c5e-a910-9b1ca7724555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd1468-f539-4742-b455-ffe9637a51ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd1468-f539-4742-b455-ffe9637a51ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222034952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670b03ba-70d4-4142-8d00-3d04c8087f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:56Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd786b5-104e-4737-a50c-2a2942b56d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd786b5-104e-4737-a50c-2a2942b56d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5339f2e-6ab5-49b3-b5e0-d23c1315c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5339f2e-6ab5-49b3-b5e0-d23c1315c308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670b03ba-70d4-4142-8d00-3d04c8087f39', 'volume_name': 'volume-670b03ba-70d4-4142-8d00-3d04c8087f39', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f9bb7c-9e82-4f54-ac84-e5c4db29e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f9bb7c-9e82-4f54-ac84-e5c4db29e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0561c-7059-4d98-a378-229dc6fe5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Volume 670b03ba-70d4-4142-8d00-3d04c8087f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670b03ba-70d4-4142-8d00-3d04c8087f39', 'volume_size': 1} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-222034952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670b03ba-70d4-4142-8d00-3d04c8087f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb1be6650104a5d8248f2a0574f1eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:56Z,use_quota=True,user_id='46bf34e9af444408971ce97ce0aa5924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Creating volume 670b03ba-70d4-4142-8d00-3d04c8087f39 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:56 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 1073741824 Nov 02 10:52:56 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:56 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:52:56 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:56 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:52:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Deleted volume successfully. Nov 02 10:52:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fd136a3d-b48e-4b9b-83a5-b9dacc152769 tempest-VolumesTransfersTest-1488848821 None] Lock "cinder-3b6508ab-cd81-46fe-a7a6-35e879d0f3a1-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:52:57 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 1073741824" returned: 0 in 0.604s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:57 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 Nov 02 10:52:57 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (fda6ecf9-24ad-4952-9377-51fd41127469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:57 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ad93d-52a6-4e26-8329-a9f7db82c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ad93d-52a6-4e26-8329-a9f7db82c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394642948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,host='devstack@QuobyteHD#QuobyteHD',id=ef8628e2-e0b0-41a4-9cd6-aebd0e82333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:57Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2),volume_type_id=c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d62cf0-6be3-4d3b-9d24-db37cadd56b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d62cf0-6be3-4d3b-9d24-db37cadd56b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98322b-85ad-4655-8011-04c93912dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98322b-85ad-4655-8011-04c93912dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8628e2-e0b0-41a4-9cd6-aebd0e82333f', 'volume_name': 'volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dd270d-4d65-4d48-a3d6-0eb963da65c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dd270d-4d65-4d48-a3d6-0eb963da65c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56794b11-b084-445d-ae88-ffb37fe4e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Volume ef8628e2-e0b0-41a4-9cd6-aebd0e82333f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f', 'volume_size': 1} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,created_at=2026-11-02T09:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394642948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,host='devstack@QuobyteHD#QuobyteHD',id=ef8628e2-e0b0-41a4-9cd6-aebd0e82333f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:52:57Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2),volume_type_id=c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Creating volume ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:57 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0561c-7059-4d98-a378-229dc6fe5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670b03ba-70d4-4142-8d00-3d04c8087f39', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f 1073741824 Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6f3aa3-c167-4867-9e2c-f184110bdbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:57 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Volume volume-670b03ba-70d4-4142-8d00-3d04c8087f39 (670b03ba-70d4-4142-8d00-3d04c8087f39): created successfully Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6f3aa3-c167-4867-9e2c-f184110bdbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Flow 'volume_create_manager' (d3350d1c-0914-4c5e-a910-9b1ca7724555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1635fdc6-67c9-440d-b832-413a6e21523b tempest-VolumesActionsTest-1699828421 None] Created volume successfully. Nov 02 10:52:58 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f 1073741824" returned: 0 in 0.534s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:58 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f Nov 02 10:52:58 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:58 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56794b11-b084-445d-ae88-ffb37fe4e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58212802-f1d4-4a51-a673-82b22feb04ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Volume volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f (ef8628e2-e0b0-41a4-9cd6-aebd0e82333f): created successfully Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58212802-f1d4-4a51-a673-82b22feb04ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (fda6ecf9-24ad-4952-9377-51fd41127469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d4dff39-e6a4-40fb-80e3-9f7de85c62b0 tempest-GroupSnapshotsTest-1025716839 None] Created volume successfully. Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-670b03ba-70d4-4142-8d00-3d04c8087f39-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "cinder-670b03ba-70d4-4142-8d00-3d04c8087f39-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Acquiring lock "cinder-quobyte-670b03ba-70d4-4142-8d00-3d04c8087f39" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "cinder-quobyte-670b03ba-70d4-4142-8d00-3d04c8087f39" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ec35c-9845-413a-911f-07b1e76e87fe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:59 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 Nov 02 10:52:59 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (edea201a-4cd9-4900-b5c1-112da6dfc002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3056d-7214-4872-a9c1-5a117978cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3056d-7214-4872-a9c1-5a117978cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472242756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,host='devstack@QuobyteHD#QuobyteHD',id=34b77ff7-e64a-46bd-9c18-c41973e9f848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:00Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2),volume_type_id=c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba7dbfa-5be2-4370-a657-fb4677e08c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba7dbfa-5be2-4370-a657-fb4677e08c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a578bc-d581-4540-bb48-5437f9858146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a578bc-d581-4540-bb48-5437f9858146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b77ff7-e64a-46bd-9c18-c41973e9f848', 'volume_name': 'volume-34b77ff7-e64a-46bd-9c18-c41973e9f848', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444e865c-799d-4ceb-b0f1-024cdcf404fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444e865c-799d-4ceb-b0f1-024cdcf404fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0c59f0-26c0-4d23-ad9d-992108c7d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:52:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Volume 34b77ff7-e64a-46bd-9c18-c41973e9f848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b77ff7-e64a-46bd-9c18-c41973e9f848', 'volume_size': 1} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,created_at=2026-11-02T09:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472242756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb70bc5-18c6-4f03-857f-15a71aa3797e,host='devstack@QuobyteHD#QuobyteHD',id=34b77ff7-e64a-46bd-9c18-c41973e9f848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:00Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2),volume_type_id=c95c2a18-7bd2-4e18-a2c6-b6694e9db3e2)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Creating volume 34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:52:59 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:52:59 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 1073741824 Nov 02 10:52:59 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:52:59 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39" returned: 0 in 0.608s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:52:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:00 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39 Nov 02 10:53:00 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:00 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-670b03ba-70d4-4142-8d00-3d04c8087f39" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "cinder-quobyte-670b03ba-70d4-4142-8d00-3d04c8087f39" released by "delete_volume" :: held 1.124s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Created reservations ['4e671c2f-02a1-4608-9290-2c676b018e3e', 'c6517a48-179f-48cd-9a97-ee59649e0792', '7cc6419f-50b2-47f8-98f2-567295825491', '3649457e-0547-45fc-b044-c2fbfb17bec3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:00 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 1073741824" returned: 0 in 0.675s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:00 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:00 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:00 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 Nov 02 10:53:00 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:01 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:01 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0c59f0-26c0-4d23-ad9d-992108c7d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b77ff7-e64a-46bd-9c18-c41973e9f848', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfc1662-6f8a-4c98-a937-718977e27540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Volume volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 (34b77ff7-e64a-46bd-9c18-c41973e9f848): created successfully Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfc1662-6f8a-4c98-a937-718977e27540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (edea201a-4cd9-4900-b5c1-112da6dfc002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Deleted volume successfully. Nov 02 10:53:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8da13df-a140-4c93-a4dd-700bd48893d7 tempest-GroupSnapshotsTest-1025716839 None] Created volume successfully. Nov 02 10:53:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-09e6de73-4d30-4027-ba78-ec1c3a61744d tempest-VolumesActionsTest-1699828421 None] Lock "cinder-670b03ba-70d4-4142-8d00-3d04c8087f39-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-14c72997-e9f3-4519-b1f6-4bc5351dbac5 tempest-GroupSnapshotsTest-1025716839 None] Update group completed successfully. Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Flow 'volume_create_manager' (e82956f2-5f93-48b4-b9d3-f7607abb4b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f73b94-6711-4499-aefc-4e61affee144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f73b94-6711-4499-aefc-4e61affee144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1325553094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cdc053d-44ae-4212-9607-2628c9cd26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4b1bf700f0440d8621252e9b4c9685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:04Z,use_quota=True,user_id='9cf9711c3b98499aad048d8f230a10b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43018837-cbda-4e3f-93bf-539d7283d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43018837-cbda-4e3f-93bf-539d7283d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb14c9d-22b0-4c65-b7d2-2c0a89cf01e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb14c9d-22b0-4c65-b7d2-2c0a89cf01e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cdc053d-44ae-4212-9607-2628c9cd26e5', 'volume_name': 'volume-8cdc053d-44ae-4212-9607-2628c9cd26e5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb11c35-e167-46f8-b76f-b69b38c2778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb11c35-e167-46f8-b76f-b69b38c2778e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a98b6e-b474-4b89-b1d7-e8a10720dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Volume 8cdc053d-44ae-4212-9607-2628c9cd26e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cdc053d-44ae-4212-9607-2628c9cd26e5', 'volume_size': 1} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1325553094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cdc053d-44ae-4212-9607-2628c9cd26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4b1bf700f0440d8621252e9b4c9685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:04Z,use_quota=True,user_id='9cf9711c3b98499aad048d8f230a10b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Creating volume 8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:53:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6c851071-fea7-4727-8640-4288be34ac8e tempest-GroupSnapshotsTest-1025716839 None] Update group completed successfully. Nov 02 10:53:03 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 1073741824 Nov 02 10:53:03 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:04 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 1073741824" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:04 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:53:04 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:04 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a98b6e-b474-4b89-b1d7-e8a10720dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cdc053d-44ae-4212-9607-2628c9cd26e5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f44f52f-a16f-49c0-b098-f96bee19184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Volume volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 (8cdc053d-44ae-4212-9607-2628c9cd26e5): created successfully Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f44f52f-a16f-49c0-b098-f96bee19184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Flow 'volume_create_manager' (e82956f2-5f93-48b4-b9d3-f7607abb4b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-81becbe7-d81f-4e30-aeaa-261074bdc3eb tempest-VolumesActionsTest-1097873778 None] Created volume successfully. Nov 02 10:53:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9e0d560b-ee46-49dd-a264-12df9cb0b069 tempest-GroupSnapshotsTest-1025716839 None] Update group completed successfully. Nov 02 10:53:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e5064b68-b079-4a47-880c-4ea23cef5703 tempest-GroupSnapshotsTest-1025716839 None] Update group completed successfully. Nov 02 10:53:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] GroupSnapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: creating. Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Group snapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Flow 'volume_create_manager' (36f91c25-ac81-48b1-be02-07340a921e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902fb9e2-70a7-4317-bda6-038f70c2de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902fb9e2-70a7-4317-bda6-038f70c2de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1564589094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064a9a98-29ba-49ec-9852-4c16e979c8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3579820b474a84bc718070c9cf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:08Z,use_quota=True,user_id='0ba2f992261340ab9e6a7b0238605cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0321933-25e5-4a7e-a801-7f3f8e8a638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0321933-25e5-4a7e-a801-7f3f8e8a638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc6d0b1-844a-498e-8e60-b90089c85f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc6d0b1-844a-498e-8e60-b90089c85f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064a9a98-29ba-49ec-9852-4c16e979c8b1', 'volume_name': 'volume-064a9a98-29ba-49ec-9852-4c16e979c8b1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c087286-8191-4af2-bfa6-719d4e1de853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c087286-8191-4af2-bfa6-719d4e1de853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161a1b51-5c74-4c3b-a382-8774dd8114b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Volume 064a9a98-29ba-49ec-9852-4c16e979c8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064a9a98-29ba-49ec-9852-4c16e979c8b1', 'volume_size': 1} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Creating offline snapshot 8093f666-0a8f-4591-b59f-1f28c94b1a36 of volume 34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a536594-09b8-4b39-9863-f1e5fe28618a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:08 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 Nov 02 10:53:08 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:08 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:08 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 1G Nov 02 10:53:08 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:09 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 1G" returned: 0 in 0.675s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:09 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:09 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:09 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:09 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:09 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:53:09 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:09 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:09 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 Nov 02 10:53:09 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:10 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:10 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info Nov 02 10:53:10 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:10 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:10 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:10 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info Nov 02 10:53:10 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:10 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.info" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Creating offline snapshot b6f15874-e334-40ed-9bb8-d9e533b6d45e of volume ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e31fa2-b40f-43ac-b1cf-1073eba2262a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:11 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f Nov 02 10:53:11 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:11 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:11 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e 1G Nov 02 10:53:11 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:12 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e 1G" returned: 0 in 0.948s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:12 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e Nov 02 10:53:12 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:12 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e" returned: 0 in 0.666s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:12 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:13 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e Nov 02 10:53:13 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:13 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:13 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info Nov 02 10:53:13 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:13 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:13 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info Nov 02 10:53:13 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-17e350f6-f00c-4a6e-8be9-0e864ba1196a tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-17e350f6-f00c-4a6e-8be9-0e864ba1196a tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" acquired by "attach_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:14 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.info" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.292s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.845s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1564589094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064a9a98-29ba-49ec-9852-4c16e979c8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3579820b474a84bc718070c9cf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:08Z,use_quota=True,user_id='0ba2f992261340ab9e6a7b0238605cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Creating volume 064a9a98-29ba-49ec-9852-4c16e979c8b1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-17e350f6-f00c-4a6e-8be9-0e864ba1196a tempest-VolumesActionsTest-1097873778 None] Attaching volume 8cdc053d-44ae-4212-9607-2628c9cd26e5 to instance b8de7a75-2651-4cf8-9219-82fe3c0af437 at mountpoint /dev/vdb on host None. Nov 02 10:53:14 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 1073741824 Nov 02 10:53:14 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-17e350f6-f00c-4a6e-8be9-0e864ba1196a tempest-VolumesActionsTest-1097873778 None] Attach volume completed successfully. Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-17e350f6-f00c-4a6e-8be9-0e864ba1196a tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" released by "attach_volume" :: held 0.205s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-58541cc9-bb7c-4084-a4eb-3927ebf376ac tempest-GroupSnapshotsTest-1025716839 None] group_snapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: created successfully Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54afae08-027a-4201-9421-ae4b925d905d tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54afae08-027a-4201-9421-ae4b925d905d tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-54afae08-027a-4201-9421-ae4b925d905d tempest-VolumesActionsTest-1097873778 None] Detaching volume 8cdc053d-44ae-4212-9607-2628c9cd26e5 from instance b8de7a75-2651-4cf8-9219-82fe3c0af437. Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-54afae08-027a-4201-9421-ae4b925d905d tempest-VolumesActionsTest-1097873778 None] Detach volume completed successfully. Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54afae08-027a-4201-9421-ae4b925d905d tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: deleting Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:14 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-8093f666-0a8f-4591-b59f-1f28c94b1a36" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 1073741824" returned: 0 in 0.823s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-8093f666-0a8f-4591-b59f-1f28c94b1a36" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Deleting offline snapshot 8093f666-0a8f-4591-b59f-1f28c94b1a36 of volume 34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] snapshot_file for this snap is: volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489b990-4d48-48de-a9e4-505ed0f4c04a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:15 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 Nov 02 10:53:15 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:15 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 Nov 02 10:53:15 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:15 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1" returned: 0 in 0.577s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161a1b51-5c74-4c3b-a382-8774dd8114b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064a9a98-29ba-49ec-9852-4c16e979c8b1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f854e993-f992-4a88-bce6-95c4f1fbc5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Volume volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 (064a9a98-29ba-49ec-9852-4c16e979c8b1): created successfully Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f854e993-f992-4a88-bce6-95c4f1fbc5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Flow 'volume_create_manager' (36f91c25-ac81-48b1-be02-07340a921e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-91fe214f-f4bd-4b16-a4dd-58675ca15947 tempest-VolumesTransfersV357Test-210538335 None] Created volume successfully. Nov 02 10:53:15 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36" returned: 0 in 0.739s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b77ff7-e64a-46bd-9c18-c41973e9f848(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a29ed-7168-4ff5-8a88-0c0da99e9b46]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:16 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 Nov 02 10:53:16 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:16 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:16 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 Nov 02 10:53:16 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:16 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:16 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36 Nov 02 10:53:16 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:17 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848.8093f666-0a8f-4591-b59f-1f28c94b1a36" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-8093f666-0a8f-4591-b59f-1f28c94b1a36" released by "_delete_snapshot" :: held 2.169s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" released by "delete_snapshot" :: held 2.236s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-b6f15874-e334-40ed-9bb8-d9e533b6d45e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b6f15874-e334-40ed-9bb8-d9e533b6d45e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Deleting offline snapshot b6f15874-e334-40ed-9bb8-d9e533b6d45e of volume ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] snapshot_file for this snap is: volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be0dee6-434e-4f3a-981a-92928a1fc130]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:17 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e Nov 02 10:53:17 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:17 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[685aa309-4e6b-4835-a560-0eb15f5c81a8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:17 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f Nov 02 10:53:17 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-845fae8e-3690-40d6-a358-211cf0acd35a tempest-VolumesTransfersV357Test-1408545677 None] Transfer volume completed successfully. Nov 02 10:53:18 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:18 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e Nov 02 10:53:18 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:18 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:18 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e Nov 02 10:53:18 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "cinder-064a9a98-29ba-49ec-9852-4c16e979c8b1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:19 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-064a9a98-29ba-49ec-9852-4c16e979c8b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f.b6f15874-e334-40ed-9bb8-d9e533b6d45e" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b6f15874-e334-40ed-9bb8-d9e533b6d45e" released by "_delete_snapshot" :: held 1.928s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" released by "delete_snapshot" :: held 1.963s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "cinder-quobyte-064a9a98-29ba-49ec-9852-4c16e979c8b1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-quobyte-064a9a98-29ba-49ec-9852-4c16e979c8b1" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5339adc-37d6-49ac-84a8-ca32ce20fa4f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:19 devstack cinder-volume[86783]: WARNING cinder.quota [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-405496953 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-405496953, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:19 devstack cinder-volume[86783]: WARNING cinder.quota [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-405496953 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-405496953, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['ef01db40-7be3-48b2-a10a-15e58c3efae8', '1cfff100-ebe5-45c5-9b26-a65409bf8eae', 'd4ee9ff7-3344-4831-9b94-e88c94acd2b9', 'e7971ac0-3f89-4c77-989c-e556d33d0679'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:19 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 Nov 02 10:53:19 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['65b479e1-dbe6-4973-b85e-b5fec0e01cb0', 'fbee5afb-2087-401e-9d5c-b93c02fa2e9e', 'ba9ec6ca-6c36-4bb7-a37a-aa59838ac4f4', '0e7fa991-5356-4aab-82bd-ce28bd9296b4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fa0b1a1e-9fb6-402a-acbb-93b3bbd4c826 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot d3c9b97f-8555-481b-a3e6-4a15323e22e9: deleted successfully Nov 02 10:53:19 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:19 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1 Nov 02 10:53:19 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-064a9a98-29ba-49ec-9852-4c16e979c8b1" returned: 0 in 0.360s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-quobyte-064a9a98-29ba-49ec-9852-4c16e979c8b1" released by "delete_volume" :: held 0.913s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (0cb70b85-3436-4d33-9b83-43001311e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c4104-2da0-423e-abc5-c4ea67b3a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" acquired by "delete_volume" :: waited 0.081s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c4104-2da0-423e-abc5-c4ea67b3a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1900785224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904daf9f-3ea0-4199-b86f-d158bf19859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb4f1378af4a6591d71fc52973f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='b47d23864dde44aaa6d84dc31d6b84cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215d7ff8-b4d0-49f9-bc81-42a0974c65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215d7ff8-b4d0-49f9-bc81-42a0974c65a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e44ea9-ec04-452d-958b-b5371a3a66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e44ea9-ec04-452d-958b-b5371a3a66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904daf9f-3ea0-4199-b86f-d158bf19859b', 'volume_name': 'volume-904daf9f-3ea0-4199-b86f-d158bf19859b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a91a761-c328-44b1-b9fc-e5c014fe98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a91a761-c328-44b1-b9fc-e5c014fe98dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03110f85-1231-4dee-a223-3fab4ef7b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Volume 904daf9f-3ea0-4199-b86f-d158bf19859b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904daf9f-3ea0-4199-b86f-d158bf19859b', 'volume_size': 1} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1900785224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904daf9f-3ea0-4199-b86f-d158bf19859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb4f1378af4a6591d71fc52973f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:20Z,use_quota=True,user_id='b47d23864dde44aaa6d84dc31d6b84cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Creating volume 904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:20 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d79b66-76bb-478e-a9f7-5fd0a46f0c73]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b 1073741824 Nov 02 10:53:20 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Created reservations ['d1a323a2-2fef-4cd1-a474-ba2fe7769155', '5719bea9-b488-4f1a-be20-379de9ab5612', '9919afb2-3a20-4dad-8937-d598973ab86a', '436471ec-b6d8-479d-bb90-3f16f2f8407d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 Nov 02 10:53:20 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:20 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:20 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Deleted volume successfully. Nov 02 10:53:20 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848 Nov 02 10:53:20 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9918c95f-fe5d-4f34-94a4-831d117bc72e tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-064a9a98-29ba-49ec-9852-4c16e979c8b1-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:21 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b 1073741824" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:21 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-34b77ff7-e64a-46bd-9c18-c41973e9f848" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-34b77ff7-e64a-46bd-9c18-c41973e9f848" released by "delete_volume" :: held 0.988s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[535dfa58-bcd9-4887-91ce-63a7a50f01ff]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:21 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:21 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03110f85-1231-4dee-a223-3fab4ef7b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904daf9f-3ea0-4199-b86f-d158bf19859b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ee3477-70fa-4380-be7b-f050de2c24b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Volume volume-904daf9f-3ea0-4199-b86f-d158bf19859b (904daf9f-3ea0-4199-b86f-d158bf19859b): created successfully Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ee3477-70fa-4380-be7b-f050de2c24b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (0cb70b85-3436-4d33-9b83-43001311e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b89b20de-5652-46ac-a104-100486d29bdc tempest-VolumesDeleteCascade-573767750 None] Created volume successfully. Nov 02 10:53:22 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" returned: 0 in 0.650s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f Nov 02 10:53:22 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Flow 'volume_create_manager' (e5ecc674-f6c7-41d5-a327-0d1d126de363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a1cfbc-a315-4892-a45e-d6d03e3f5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:22 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" returned: 0 in 0.515s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-ef8628e2-e0b0-41a4-9cd6-aebd0e82333f" released by "delete_volume" :: held 1.285s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a1cfbc-a315-4892-a45e-d6d03e3f5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1462308096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e4c7aa-0e54-47aa-aa98-d84f189a77b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3579820b474a84bc718070c9cf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:22Z,use_quota=True,user_id='0ba2f992261340ab9e6a7b0238605cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb6af53-b235-41a0-bea7-ba9c8b9b5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb6af53-b235-41a0-bea7-ba9c8b9b5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c205d8-944f-4a44-91f2-f1b97e997f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c205d8-944f-4a44-91f2-f1b97e997f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e4c7aa-0e54-47aa-aa98-d84f189a77b5', 'volume_name': 'volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf720dc-8422-4adb-9dfa-0848bcd3e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf720dc-8422-4adb-9dfa-0848bcd3e030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60596f9d-f4f1-44c7-8f7a-24e8731c52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Volume 55e4c7aa-0e54-47aa-aa98-d84f189a77b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5', 'volume_size': 1} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1462308096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e4c7aa-0e54-47aa-aa98-d84f189a77b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3579820b474a84bc718070c9cf3bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:22Z,use_quota=True,user_id='0ba2f992261340ab9e6a7b0238605cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Creating volume 55e4c7aa-0e54-47aa-aa98-d84f189a77b5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:22 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:22 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 1073741824 Nov 02 10:53:22 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['d1a4f61b-a2a0-4ef3-9b9f-81d8075f2a9c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:22 devstack cinder-volume[86783]: WARNING cinder.quota [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-405496953 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-405496953, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['29c6acb3-0dc2-4e0e-af28-ea84a62aa495', 'ff5ce127-6e4b-4b48-bdb3-6014f2a26246', 'a1323c45-0ac0-4dd3-adc7-0c5bac0fbd56', 'd3ea80b1-90ad-492f-9efa-2cbbce9aae79'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['492c705d-c24c-4c54-b8b7-7942ed5ee5b7', '2340102f-674e-4675-be58-084ae67e7eb1', '94dbea15-14c4-4758-82d6-7c12e794b24a', '144c75d4-695f-434f-92c7-839d45217ce9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:23 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:23 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 1073741824" returned: 0 in 0.534s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 Nov 02 10:53:23 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:23 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5f1518f3-5020-4c0d-ae48-cef0de6102e0 tempest-GroupSnapshotsTest-1025716839 None] Delete group completed successfully. Nov 02 10:53:23 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.873s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Creating offline snapshot 35eac2cc-534d-427e-8f86-0f6a9f90d593 of volume 904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de799839-58ab-4b5c-8192-3ca0e3349bd2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60596f9d-f4f1-44c7-8f7a-24e8731c52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0f0544-2570-4016-90a9-d3907a27ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Volume volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 (55e4c7aa-0e54-47aa-aa98-d84f189a77b5): created successfully Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0f0544-2570-4016-90a9-d3907a27ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Flow 'volume_create_manager' (e5ecc674-f6c7-41d5-a327-0d1d126de363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e2f385f9-b01e-4733-8aeb-b5923d601c56 tempest-VolumesTransfersV357Test-210538335 None] Created volume successfully. Nov 02 10:53:23 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:23 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.590s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:24 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 1G Nov 02 10:53:24 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-289dc90f-b366-4466-996d-61cb857bdaca tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-927668021: creating Nov 02 10:53:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-289dc90f-b366-4466-996d-61cb857bdaca tempest-GroupSnapshotsTest-1025716839 None] Group tempest-GroupSnapshotsTest-Group-927668021: created successfully Nov 02 10:53:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-289dc90f-b366-4466-996d-61cb857bdaca tempest-GroupSnapshotsTest-1025716839 None] Create group completed successfully. Nov 02 10:53:25 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 1G" returned: 0 in 0.776s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:25 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "cinder-55e4c7aa-0e54-47aa-aa98-d84f189a77b5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-55e4c7aa-0e54-47aa-aa98-d84f189a77b5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "cinder-quobyte-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-quobyte-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ecc9b8-9464-42cc-8836-ae1b39b5c44c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 Nov 02 10:53:25 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:25 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.596s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:25 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 is being set with open permissions: ugo+rw Nov 02 10:53:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:25 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:25 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" returned: 0 in 0.562s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5 Nov 02 10:53:26 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info Nov 02 10:53:26 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-quobyte-55e4c7aa-0e54-47aa-aa98-d84f189a77b5" released by "delete_volume" :: held 1.107s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:26 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info is being set with open permissions: ugo+rw Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info Nov 02 10:53:26 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Created reservations ['ebe4658e-1c95-489a-9442-32e963044193', 'f9940558-1479-45c4-b40f-d0b9febe352e', 'fd4eb148-2a98-45bf-81a0-a54b4b227142', '14a75791-b65d-4e85-9efb-0f195a9e41db'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (905d20dd-2744-4ced-92c2-bae3b1b607e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0691b84a-cda1-4461-ba11-a8c3e6edd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba7c1117-e2c7-4173-b82e-8532c3caa122 tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:26 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:26 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0691b84a-cda1-4461-ba11-a8c3e6edd552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122161132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f11804c6-2d12-40a6-830a-cc41448cf4af,host='devstack@QuobyteHD#QuobyteHD',id=b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:27Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17ffebdf-2f1f-4b68-8826-733fad4e9c56),volume_type_id=17ffebdf-2f1f-4b68-8826-733fad4e9c56)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c3717-8c47-4ae0-950c-cf94d43e0a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511c3717-8c47-4ae0-950c-cf94d43e0a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0571736-56ea-4fe9-a3e9-3ba2c7503ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0571736-56ea-4fe9-a3e9-3ba2c7503ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe', 'volume_name': 'volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5726a-363a-412b-a025-9a43563d883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f5726a-363a-412b-a025-9a43563d883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e950e2-d5cc-4688-95bd-b572f8b404ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Volume b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe', 'volume_size': 1} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba7c1117-e2c7-4173-b82e-8532c3caa122 tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" acquired by "attach_volume" :: waited 0.097s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:27 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.info" returned: 0 in 0.539s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.455s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f11804c6-2d12-40a6-830a-cc41448cf4af,created_at=2026-11-02T09:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122161132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f11804c6-2d12-40a6-830a-cc41448cf4af,host='devstack@QuobyteHD#QuobyteHD',id=b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dff34a3c3ec4f409e0066c035231d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:27Z,use_quota=True,user_id='9d92be408d434eda811a17566b539fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17ffebdf-2f1f-4b68-8826-733fad4e9c56),volume_type_id=17ffebdf-2f1f-4b68-8826-733fad4e9c56)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Creating volume b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:27 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe 1073741824 Nov 02 10:53:27 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-eed4abae-51fa-4ae0-8d85-dbc815c89459 tempest-VolumesDeleteCascade-573767750 None] Create snapshot completed successfully Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba7c1117-e2c7-4173-b82e-8532c3caa122 tempest-VolumesActionsTest-1097873778 None] Attaching volume 8cdc053d-44ae-4212-9607-2628c9cd26e5 to instance bd58b9fb-3c24-441b-b7d6-b1551cf5aac7 at mountpoint /dev/vdb on host None. Nov 02 10:53:27 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba7c1117-e2c7-4173-b82e-8532c3caa122 tempest-VolumesActionsTest-1097873778 None] Attach volume completed successfully. Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Deleted volume successfully. Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba7c1117-e2c7-4173-b82e-8532c3caa122 tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5" released by "attach_volume" :: held 0.218s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-32bb0517-d6ef-425c-9e90-3f08113675fb tempest-VolumesTransfersV357Test-372356763 None] Lock "cinder-55e4c7aa-0e54-47aa-aa98-d84f189a77b5-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-62c036a9-6ce9-4ca6-8ad7-6320be54331c tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-62c036a9-6ce9-4ca6-8ad7-6320be54331c tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-62c036a9-6ce9-4ca6-8ad7-6320be54331c tempest-VolumesActionsTest-1097873778 None] Detaching volume 8cdc053d-44ae-4212-9607-2628c9cd26e5 from instance bd58b9fb-3c24-441b-b7d6-b1551cf5aac7. Nov 02 10:53:27 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe 1073741824" returned: 0 in 0.721s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-62c036a9-6ce9-4ca6-8ad7-6320be54331c tempest-VolumesActionsTest-1097873778 None] Detach volume completed successfully. Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-62c036a9-6ce9-4ca6-8ad7-6320be54331c tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:27 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe Nov 02 10:53:27 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:28 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e950e2-d5cc-4688-95bd-b572f8b404ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07888561-1196-4645-91d4-42602283c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Volume volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe (b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe): created successfully Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07888561-1196-4645-91d4-42602283c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Flow 'volume_create_manager' (905d20dd-2744-4ced-92c2-bae3b1b607e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e753b7b5-65b0-42be-bbee-585f6235449a tempest-GroupSnapshotsTest-1025716839 None] Created volume successfully. Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Creating offline snapshot fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 of volume 904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7962ee1-64bb-40ba-8bf2-f6aa6e0a5dd5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:28 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:28 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:29 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904daf9f-3ea0-4199-b86f-d158bf19859b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:29 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 1G Nov 02 10:53:29 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] GroupSnapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: creating. Nov 02 10:53:30 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Group snapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 1G" returned: 0 in 0.825s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:30 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:30 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:30 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:30 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 is being set with open permissions: ugo+rw Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:30 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:30 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:30 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.689s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Creating offline snapshot 0ad731c7-27e1-4af3-8d0e-a8991e63ff4c of volume b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:53:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a8d7bc1c-df3a-4ee4-bed2-8c7b0a8ce615 tempest-VolumesDeleteCascade-573767750 None] Create snapshot completed successfully Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137da60-35e1-4c50-95f2-44c07d436b62]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:30 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe Nov 02 10:53:30 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:31 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:31 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c 1G Nov 02 10:53:31 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:31 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c 1G" returned: 0 in 0.569s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:31 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c Nov 02 10:53:31 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-904daf9f-3ea0-4199-b86f-d158bf19859b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-904daf9f-3ea0-4199-b86f-d158bf19859b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Performing cascade delete. {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-35eac2cc-534d-427e-8f86-0f6a9f90d593-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-35eac2cc-534d-427e-8f86-0f6a9f90d593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-35eac2cc-534d-427e-8f86-0f6a9f90d593" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-35eac2cc-534d-427e-8f86-0f6a9f90d593" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Deleting offline snapshot 35eac2cc-534d-427e-8f86-0f6a9f90d593 of volume 904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] snapshot_file for this snap is: volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa3aba8-6bcc-46e3-a61e-61261c3f57c7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" returned: 0 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c Nov 02 10:53:32 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:32 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info Nov 02 10:53:32 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904daf9f-3ea0-4199-b86f-d158bf19859b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c92804-f6f4-4ec3-bde1-696a99c04d01]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:32 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:32 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 10:53:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:32 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info Nov 02 10:53:32 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:33 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd6db8-dcb0-476d-91e3-b42575d38778]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.info" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.172s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971f5eb-b5c2-4d8b-bab4-9b8518e4ffe7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:33 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce10cdb3-d1f8-4c67-95c6-9ae40cc1fa4a tempest-GroupSnapshotsTest-1025716839 None] group_snapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: created successfully Nov 02 10:53:33 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:53:33 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904daf9f-3ea0-4199-b86f-d158bf19859b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce105f84-7b63-42fd-814c-15000d42e588]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.453s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:33 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:33 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0f743-39f4-4c03-8467-dd7349bab625]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:33 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:53:33 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904daf9f-3ea0-4199-b86f-d158bf19859b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad67b6-dbea-41db-9184-cd98e3cbd760]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.ed47a660-dfec-4487-ae9e-aa4769b5284aqexr6dxj.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:34 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.ed47a660-dfec-4487-ae9e-aa4769b5284aqexr6dxj.img Nov 02 10:53:34 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: deleting Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 10:53:34 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.472s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:34 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:34 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Deleting offline snapshot 0ad731c7-27e1-4af3-8d0e-a8991e63ff4c of volume b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] snapshot_file for this snap is: volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1631fe64-5fdf-4592-b36f-6a9af6cabfdb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:34 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c Nov 02 10:53:34 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.796s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593 Nov 02 10:53:35 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" returned: 0 in 0.738s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b5414f-57b1-4f83-bb57-783ea7e4dab2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe Nov 02 10:53:35 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:35 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.35eac2cc-534d-427e-8f86-0f6a9f90d593" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 -F qcow2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:35 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 -F qcow2 Nov 02 10:53:35 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:36 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" returned: 0 in 0.802s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:36 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c Nov 02 10:53:36 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:36 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904daf9f-3ea0-4199-b86f-d158bf19859b /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 -F qcow2" returned: 0 in 0.736s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-35eac2cc-534d-427e-8f86-0f6a9f90d593" released by "_delete_snapshot" :: held 4.623s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" released by "delete_snapshot" :: held 4.663s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['d9de447d-867a-4d38-85ef-40dced10a795', 'f20f121b-c11e-41ba-8b83-691e97f82280', 'e8976f01-9879-4f0f-8b5b-dd8e9af4a5e7', '8e9b44fc-4256-4268-a329-2289c57ecf67'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Delete snapshot completed successfully. Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-35eac2cc-534d-427e-8f86-0f6a9f90d593-delete_snapshot" released by "delete_snapshot" :: held 4.940s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Flow 'volume_create_manager' (dec3b27b-ce08-45d8-b3bf-5bf49e279b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c6bc5-e890-40a8-9a2e-9b2c4795ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c6bc5-e890-40a8-9a2e-9b2c4795ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-267859269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd343c2a-9375-4ec0-93be-8fa18e0d8548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9a702cacb24f13beb84adb2fd91a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:37Z,use_quota=True,user_id='f97305b1e0d342dc9f4b1c9526c7f837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034dddf4-82d2-4743-bde6-27e3b7a323ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034dddf4-82d2-4743-bde6-27e3b7a323ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152f9b78-da09-4a78-bce7-7ae601eee194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152f9b78-da09-4a78-bce7-7ae601eee194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'volume_name': 'volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceab6bb-4e4b-4efa-9d37-5eaa0afaba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceab6bb-4e4b-4efa-9d37-5eaa0afaba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf5423-3786-42d8-98c9-0b2fd7153be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Volume bd343c2a-9375-4ec0-93be-8fa18e0d8548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'volume_size': 1} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:37 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" returned: 0 in 0.833s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:37 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c Nov 02 10:53:37 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Deleting offline snapshot fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 of volume 904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] snapshot_file for this snap is: volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1f998-7128-4db6-8835-061a949f8f22]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:37 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:37 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:37 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe.0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-0ad731c7-27e1-4af3-8d0e-a8991e63ff4c" released by "_delete_snapshot" :: held 3.010s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" released by "delete_snapshot" :: held 3.059s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:37 devstack cinder-volume[86783]: WARNING cinder.quota [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-310118458 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-310118458, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:37 devstack cinder-volume[86783]: WARNING cinder.quota [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-310118458 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-310118458, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['12036f0c-4944-4e14-9d40-b7cf0604167d', '8d1a8a3c-1a8d-4287-8faa-962cc6e1f5e5', 'fde83d60-406a-4a25-9a18-4337bc3c23b1', '235f90ee-1619-4340-8dae-eaf8cd3dc201'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-926f9785-01e4-48c7-a776-1b078f7565f1 tempest-GroupSnapshotsTest-1025716839 None] group_snapshot b0598b3a-fa15-4d9b-91f6-0290a26333ab: deleted successfully Nov 02 10:53:38 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.738s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904daf9f-3ea0-4199-b86f-d158bf19859b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e5eef-a93d-42c9-b566-78572c5ba1d9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:38 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:38 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:38 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.684s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:38 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:38 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" acquired by "delete_volume" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c60c21-9b9f-4f40-bfe2-ef408cd49670]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:39 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe Nov 02 10:53:39 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.693s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:39 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617 Nov 02 10:53:39 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" returned: 0 in 0.652s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:39 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe Nov 02 10:53:39 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:39 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b.fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617" released by "_delete_snapshot" :: held 2.839s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" released by "delete_snapshot" :: held 2.895s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:40 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Lock "cinder-quobyte-b5627aba-91a7-46f8-9a1d-8a1d76b8e7fe" released by "delete_volume" :: held 1.240s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['5b7b664d-fd26-48cd-a73b-efd45137bd84', '34907c9d-a555-4bc9-9a12-d9e187bc2894', '0eef556b-9fda-4935-b874-14195094e61e', '582b8c58-3ded-4d4c-814f-268ad6636299'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['8ea3b8dd-eb12-44eb-9463-089d3eb1d62b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:40 devstack cinder-volume[86783]: WARNING cinder.quota [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-310118458 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-310118458, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:53:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Delete snapshot completed successfully. Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-fde1d3f9-8aa4-414d-9626-bc5a2c9ae617-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Snapshots deleted, issuing volume delete {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Created reservations ['da44be0d-e1c0-473b-8929-903aac0fd3f6', 'efcc9132-1b14-4716-8066-04a0e8944f65', '5d2e97d8-59d3-434f-9298-9a4d553d45ed', '3a639dc4-0edb-48ae-8ea0-0b6cba9aba93'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bb169e-54bb-410f-8a13-b37ac5805165]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:40 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:40 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:40 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:40 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-37a8b5d0-c86b-40f4-8b72-7c9ca852d782 tempest-GroupSnapshotsTest-1025716839 None] Delete group completed successfully. Nov 02 10:53:41 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.812s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b Nov 02 10:53:41 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:41 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-904daf9f-3ea0-4199-b86f-d158bf19859b" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-904daf9f-3ea0-4199-b86f-d158bf19859b" released by "delete_volume" :: held 1.288s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['51cc5524-65b1-4a57-a077-f92e64354ef3', 'f0086edc-2bac-47f2-87be-1acc7426397c', '06e0e561-eba9-483a-a309-2c4773a310df', '56baff02-7d4a-468b-bd83-e0c52f62a973'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:53:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:41 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:53:41 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:42 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.ed47a660-dfec-4487-ae9e-aa4769b5284aqexr6dxj.img" returned: 0 in 7.946s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddde84-a7bb-4162-9fcc-f365e9e365d0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:53:42 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:53:42 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:53:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Deleted volume successfully. Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=196,cinder:UPDATE=208,cinder:DELETE=8,cinder:INSERT=38 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcb913d9-feca-4a61-9168-53bd602097f7 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-904daf9f-3ea0-4199-b86f-d158bf19859b-delete_volume" released by "delete_volume" :: held 10.431s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:53:42 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.ed47a660-dfec-4487-ae9e-aa4769b5284aqexr6dxj.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:53:42 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Converted 1024.00 MB image at 128.84 MB/s Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=177,cinder:INSERT=63,cinder:UPDATE=208,cinder:DELETE=14 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] ed47a660-dfec-4487-ae9e-aa4769b5284a was raw, no need to convert to raw {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 02 10:53:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (02e267ce-e8b5-4dbd-b92f-21cfe009654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e69e346-a58d-451e-8be6-80d595ccb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e69e346-a58d-451e-8be6-80d595ccb526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2008695401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac76aa-bf19-4eb4-8288-d225ba58e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb4f1378af4a6591d71fc52973f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:43Z,use_quota=True,user_id='b47d23864dde44aaa6d84dc31d6b84cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e6edcc-9baa-4d81-92ea-344e8fb31c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e6edcc-9baa-4d81-92ea-344e8fb31c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6158ea43-eabd-4a22-9d9f-249fd1b9e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6158ea43-eabd-4a22-9d9f-249fd1b9e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ac76aa-bf19-4eb4-8288-d225ba58e4c7', 'volume_name': 'volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599a2413-898c-4827-9bca-a983a7d15e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599a2413-898c-4827-9bca-a983a7d15e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3545cb0a-f024-431a-810f-4465d4f67e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Volume f0ac76aa-bf19-4eb4-8288-d225ba58e4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7', 'volume_size': 1} Nov 02 10:53:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:53:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-97136a7a-f80b-4f6a-93e0-86f22e17a769 tempest-GroupsTest-976077900 None] Group tempest-Group1-1968094349: creating Nov 02 10:53:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-97136a7a-f80b-4f6a-93e0-86f22e17a769 tempest-GroupsTest-976077900 None] Group tempest-Group1-1968094349: created successfully Nov 02 10:53:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-97136a7a-f80b-4f6a-93e0-86f22e17a769 tempest-GroupsTest-976077900 None] Create group completed successfully. Nov 02 10:53:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d4a411e-b895-4b21-96dd-5ae5badf78a8 tempest-GroupsTest-976077900 None] Group tempest-Group2-850880511: creating Nov 02 10:53:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d4a411e-b895-4b21-96dd-5ae5badf78a8 tempest-GroupsTest-976077900 None] Group tempest-Group2-850880511: created successfully Nov 02 10:53:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d4a411e-b895-4b21-96dd-5ae5badf78a8 tempest-GroupsTest-976077900 None] Create group completed successfully. Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (3946ce96-e1fa-4268-a376-b4a9b460314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27414e29-fa15-4278-b5b2-07419bbdc91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27414e29-fa15-4278-b5b2-07419bbdc91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800124300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9769de5-2a69-4031-9b41-5e2922f63a8a,host='devstack@QuobyteHD#QuobyteHD',id=68c77e6a-b130-46d1-b0cb-0a43fef2ef22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:51Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df454760-4678-4aa9-af06-f923c2c7563a),volume_type_id=df454760-4678-4aa9-af06-f923c2c7563a)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9f8012-eb83-4540-99f0-eb9efd3433a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9f8012-eb83-4540-99f0-eb9efd3433a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa49c031-e6e1-443c-a090-e45cea26cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa49c031-e6e1-443c-a090-e45cea26cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c77e6a-b130-46d1-b0cb-0a43fef2ef22', 'volume_name': 'volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c798a7b-d3cc-463e-84bb-d59cf67b1c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c798a7b-d3cc-463e-84bb-d59cf67b1c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302bbffd-fd32-440d-b718-43dbde4bb5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:53:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Volume 68c77e6a-b130-46d1-b0cb-0a43fef2ef22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22', 'volume_size': 1} Nov 02 10:53:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.077s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Uploaded volume to glance image-id: ed47a660-dfec-4487-ae9e-aa4769b5284a. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.198s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-267859269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd343c2a-9375-4ec0-93be-8fa18e0d8548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9a702cacb24f13beb84adb2fd91a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:37Z,use_quota=True,user_id='f97305b1e0d342dc9f4b1c9526c7f837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Creating volume bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:02 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:02 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 1073741824 Nov 02 10:54:02 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b6489aa7-e335-4dab-9c77-811f84aa230d tempest-VolumesActionsTest-1097873778 None] Copy volume to image completed successfully. Nov 02 10:54:02 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 1073741824" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:02 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:02 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.982s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2008695401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac76aa-bf19-4eb4-8288-d225ba58e4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb4f1378af4a6591d71fc52973f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:43Z,use_quota=True,user_id='b47d23864dde44aaa6d84dc31d6b84cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Creating volume f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf5423-3786-42d8-98c9-0b2fd7153be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 1073741824 Nov 02 10:54:03 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02617014-dc98-4f9b-84a2-fde2c06017a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Volume volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 (bd343c2a-9375-4ec0-93be-8fa18e0d8548): created successfully Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02617014-dc98-4f9b-84a2-fde2c06017a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Flow 'volume_create_manager' (dec3b27b-ce08-45d8-b3bf-5bf49e279b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c6007dad-5d06-485b-81ab-0b1dbef5790a tempest-VolumesCloneTest-1641674575 None] Created volume successfully. Nov 02 10:54:03 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 1073741824" returned: 0 in 0.477s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:03 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.643s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9769de5-2a69-4031-9b41-5e2922f63a8a,created_at=2026-11-02T09:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1800124300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9769de5-2a69-4031-9b41-5e2922f63a8a,host='devstack@QuobyteHD#QuobyteHD',id=68c77e6a-b130-46d1-b0cb-0a43fef2ef22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:53:51Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df454760-4678-4aa9-af06-f923c2c7563a),volume_type_id=df454760-4678-4aa9-af06-f923c2c7563a)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Creating volume 68c77e6a-b130-46d1-b0cb-0a43fef2ef22 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3545cb0a-f024-431a-810f-4465d4f67e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 1073741824 Nov 02 10:54:03 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6544464a-bac9-45e2-bbb9-8340c07f8dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Volume volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 (f0ac76aa-bf19-4eb4-8288-d225ba58e4c7): created successfully Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6544464a-bac9-45e2-bbb9-8340c07f8dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (02e267ce-e8b5-4dbd-b92f-21cfe009654a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ea893fcc-e2a2-48ef-b913-368d4e044291 tempest-VolumesDeleteCascade-573767750 None] Created volume successfully. Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Flow 'volume_create_manager' (5748b446-893d-4d37-a4f9-637b625ed6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c47299-99df-4c4d-b6b2-6d3e60728736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c47299-99df-4c4d-b6b2-6d3e60728736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-868971202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a705ad23-f4b3-4f62-af25-775e20b6cc40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9a702cacb24f13beb84adb2fd91a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=bd343c2a-9375-4ec0-93be-8fa18e0d8548,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:04Z,use_quota=True,user_id='f97305b1e0d342dc9f4b1c9526c7f837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e9eeed-9718-4a3c-ade9-b557d08404cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e9eeed-9718-4a3c-ade9-b557d08404cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6adcff-0593-4597-9c09-a8c1ac2ae790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6adcff-0593-4597-9c09-a8c1ac2ae790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a705ad23-f4b3-4f62-af25-775e20b6cc40', 'volume_name': 'volume-a705ad23-f4b3-4f62-af25-775e20b6cc40', 'volume_size': 2, 'source_volid': 'bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aebe636-787c-429d-a145-d5c49e852487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aebe636-787c-429d-a145-d5c49e852487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02549f8-b202-4c4d-9c66-0719c86cc60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Volume a705ad23-f4b3-4f62-af25-775e20b6cc40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a705ad23-f4b3-4f62-af25-775e20b6cc40', 'volume_size': 2, 'source_volid': 'bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'source_volstatus': 'available'} Nov 02 10:54:04 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 1073741824" returned: 0 in 0.612s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:04 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 Nov 02 10:54:04 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:04 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.346s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302bbffd-fd32-440d-b718-43dbde4bb5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269ea014-7b45-4387-ad8f-2cb8552a038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[28146851-4c0d-451a-9d9d-6c8c37970bfa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Volume volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 (68c77e6a-b130-46d1-b0cb-0a43fef2ef22): created successfully Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269ea014-7b45-4387-ad8f-2cb8552a038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (3946ce96-e1fa-4268-a376-b4a9b460314b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6ef7ab0d-a140-4556-b97e-03e9ab720aa3 tempest-GroupsTest-976077900 None] Created volume successfully. Nov 02 10:54:04 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:54:04 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d44ce7b-0335-4f06-9638-48c3ce941dea]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:54:05 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:05 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:05 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img Nov 02 10:54:05 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Acquiring lock "cinder-quobyte-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3badc-9b52-41af-8a49-d323572ecc58]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:06 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 Nov 02 10:54:06 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:07 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" returned: 0 in 0.813s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:07 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22 Nov 02 10:54:07 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:07 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-68c77e6a-b130-46d1-b0cb-0a43fef2ef22" released by "delete_volume" :: held 1.267s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Created reservations ['aed71c91-020d-4cb2-9443-05f95924baf2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:07 devstack cinder-volume[86783]: WARNING cinder.quota [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2024134342 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2024134342, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:54:07 devstack cinder-volume[86783]: WARNING cinder.quota [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2024134342 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2024134342, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Created reservations ['a5e4572b-f050-4cee-826a-1607f43464f9', 'c50b0bfd-4992-4488-850b-b2b5d720253c', '744d750e-d9da-4197-95c1-787375f687f8', '857c427f-4c0e-451a-b59f-bb007569e279'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:07 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:07 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:08 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-49a72b0f-b383-4b23-af38-aa387868c84d tempest-GroupsTest-976077900 None] Delete group completed successfully. Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Created reservations ['f5d17bf1-0e05-4914-87c3-b991683f32cd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:09 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:09 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:09 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9845868-9027-4f1d-8735-612c8f74a491 tempest-GroupsTest-976077900 None] Delete group completed successfully. Nov 02 10:54:09 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:09 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:09 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:54:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-889726ca-0c9b-48fd-af49-1922b355f06c tempest-GroupsTest-976077900 None] Group tempest-GroupsTest-Group-331867773: creating Nov 02 10:54:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-889726ca-0c9b-48fd-af49-1922b355f06c tempest-GroupsTest-976077900 None] Group tempest-GroupsTest-Group-331867773: created successfully Nov 02 10:54:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-889726ca-0c9b-48fd-af49-1922b355f06c tempest-GroupsTest-976077900 None] Create group completed successfully. Nov 02 10:54:11 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img" returned: 0 in 6.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbb19bf-a355-4ecf-852a-1610d9e46239]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:12 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:54:12 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:12 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:54:12 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Converted 1024.00 MB image at 161.59 MB/s Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] 2d432779-bfa5-481f-b790-17a5d2c29618 was raw, converting to qcow2 {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d389e9-01da-469f-b8ff-f9fc11132381]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (f09b1050-afbd-456f-bc34-dbbb5e339593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0407379-2b3b-472e-809a-63c2f077a520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0407379-2b3b-472e-809a-63c2f077a520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858447417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,host='devstack@QuobyteHD#QuobyteHD',id=9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:13Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b53f23f-202b-45c0-b20d-5750e3b606c4),volume_type_id=7b53f23f-202b-45c0-b20d-5750e3b606c4)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322497e-59cd-4be7-a691-33983ca5e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2322497e-59cd-4be7-a691-33983ca5e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img Nov 02 10:54:12 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb53678-ddfe-48f3-86e0-cee91cef4229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb53678-ddfe-48f3-86e0-cee91cef4229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d', 'volume_name': 'volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0b4871-59dc-4ccb-9400-25de112837c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0b4871-59dc-4ccb-9400-25de112837c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9db28-8096-4841-9182-921b2fd55725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Volume 9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d', 'volume_size': 1} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:12 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:12 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img Nov 02 10:54:13 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img" returned: 1 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:13 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s Nov 02 10:54:13 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Image conversion details: src /opt/stack/data/cinder/conversion/8cdc053d-44ae-4212-9607-2628c9cd26e5.temp_image.2d432779-bfa5-481f-b790-17a5d2c296181absuuw3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:54:13 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[188627f1-fbdd-41e8-b815-4d0976fbf91b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:13 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s Nov 02 10:54:13 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:13 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hceo7t9s" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.153s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Uploaded volume to glance image-id: 2d432779-bfa5-481f-b790-17a5d2c29618. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 10:54:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.453s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Cloning volume bd343c2a-9375-4ec0-93be-8fa18e0d8548 to volume a705ad23-f4b3-4f62-af25-775e20b6cc40 Nov 02 10:54:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-703d6eba-356f-4f05-bfb5-3938e9e2eacc tempest-VolumesActionsTest-1097873778 None] Copy volume to image completed successfully. Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Creating offline snapshot 380297c7-93a9-43fe-baf7-3926abaf8ead of volume bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1cbcf7-1e43-404f-926c-1009e856ed58]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:15 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead 1G Nov 02 10:54:15 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:15 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead 1G" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:15 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:15 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead is being set with open permissions: ugo+rw Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:16 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info Nov 02 10:54:16 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Acquiring lock "cinder-quobyte-8cdc053d-44ae-4212-9607-2628c9cd26e5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "cinder-quobyte-8cdc053d-44ae-4212-9607-2628c9cd26e5" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:16 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info is being set with open permissions: ugo+rw Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4d9905-c398-41fc-958d-95c67ae53fab]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:16 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info Nov 02 10:54:16 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:54:16 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:16 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.info" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] snapshot: 380297c7-93a9-43fe-baf7-3926abaf8ead, volume: a705ad23-f4b3-4f62-af25-775e20b6cc40, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[77459363-c5f3-4efa-903a-cbdd22e583e4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5 Nov 02 10:54:17 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:17 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8cdc053d-44ae-4212-9607-2628c9cd26e5" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "cinder-quobyte-8cdc053d-44ae-4212-9607-2628c9cd26e5" released by "delete_volume" :: held 0.679s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:17 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a949da84-43ec-4fa0-87ef-25b274a13498]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Created reservations ['612a1da1-e39f-4661-b4f5-0071131b3cd2', 'b2838ad6-8ddd-4925-ab94-04793a3847ca', 'f8668647-5d4a-4470-8899-96e97ad2d4f2', 'a5a10004-21ac-4856-9741-a60bcc1346db'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:17 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:17 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:17 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:17 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Deleted volume successfully. Nov 02 10:54:17 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 Nov 02 10:54:17 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29282bc8-b1d4-43d0-9fa2-39167a7206ee tempest-VolumesActionsTest-1097873778 None] Lock "cinder-8cdc053d-44ae-4212-9607-2628c9cd26e5-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:24 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40" returned: 0 in 7.017s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:24 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:54:24 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Converted 1024.00 MB image at 145.91 MB/s Nov 02 10:54:24 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 is being set with open permissions: ugo+rw Nov 02 10:54:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:24 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 Nov 02 10:54:24 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:24 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" released by "_copy_volume_from_snapshot" :: held 8.125s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-quobyte-380297c7-93a9-43fe-baf7-3926abaf8ead" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-380297c7-93a9-43fe-baf7-3926abaf8ead" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Deleting offline snapshot 380297c7-93a9-43fe-baf7-3926abaf8ead of volume bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] snapshot_file for this snap is: volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[13035f66-662d-49ac-9b36-6f474d1096a6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:25 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:25 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:25 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757d9a1-8b92-494d-a559-f562a50a5f46]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:25 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:25 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.590s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:26 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead Nov 02 10:54:26 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:26 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548.380297c7-93a9-43fe-baf7-3926abaf8ead" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-380297c7-93a9-43fe-baf7-3926abaf8ead" released by "_delete_snapshot" :: held 1.720s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.847s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 22.176s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02549f8-b202-4c4d-9c66-0719c86cc60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a705ad23-f4b3-4f62-af25-775e20b6cc40', 'volume_size': 2, 'source_volid': 'bd343c2a-9375-4ec0-93be-8fa18e0d8548', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b0a21-50c6-4690-a42f-4a163b34954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Creating offline snapshot 1e1ccb09-07bf-414e-aa2c-95b19a21240d of volume f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:54:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Volume volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 (a705ad23-f4b3-4f62-af25-775e20b6cc40): created successfully Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b0a21-50c6-4690-a42f-4a163b34954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Flow 'volume_create_manager' (5748b446-893d-4d37-a4f9-637b625ed6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4400546-4189-41e5-9f72-d740a7e3ac94]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5c0e44fd-c5b0-4237-89c5-5368db20de6f tempest-VolumesCloneTest-1641674575 None] Created volume successfully. Nov 02 10:54:26 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:26 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.417s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d 1G Nov 02 10:54:27 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-a705ad23-f4b3-4f62-af25-775e20b6cc40-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "cinder-a705ad23-f4b3-4f62-af25-775e20b6cc40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[46276a61-3783-42b8-83cc-6692c02dcced]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d 1G" returned: 0 in 0.551s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:27 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:27 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 Nov 02 10:54:27 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Flow 'volume_create_manager' (7c25a089-a081-4c15-8ebd-716b14f8b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899ece47-a27c-4b95-9f43-719a0bd63994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899ece47-a27c-4b95-9f43-719a0bd63994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-840439927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1284a7c-2ce1-4203-b569-7bd1fdbb764b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a76d0e6f444b2c8749e4247908ae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:28Z,use_quota=True,user_id='329501b88e384cff871a5391f8c83838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd105090-b786-4407-8a35-9cf7f33f403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd105090-b786-4407-8a35-9cf7f33f403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79fc9-1764-4f4d-b526-a7cf4354f943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79fc9-1764-4f4d-b526-a7cf4354f943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1284a7c-2ce1-4203-b569-7bd1fdbb764b', 'volume_name': 'volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50a3463-4311-44f1-b075-b421a3ac1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50a3463-4311-44f1-b075-b421a3ac1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c63f5a7-15e8-44e7-a0eb-364cf63ca499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Volume d1284a7c-2ce1-4203-b569-7bd1fdbb764b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b', 'volume_size': 1} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:28 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d is being set with open permissions: ugo+rw Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:28 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40 Nov 02 10:54:28 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a705ad23-f4b3-4f62-af25-775e20b6cc40" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-a705ad23-f4b3-4f62-af25-775e20b6cc40" released by "delete_volume" :: held 0.746s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info Nov 02 10:54:28 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Created reservations ['2ae755a3-1bd7-49b4-93a4-3cbedc6d3408', '6270cf2d-fbdf-41af-96f2-7c361481f922', '255fd6b3-efed-449c-b55a-28e057e17cb0', '2d7b5141-5e81-48c7-bffd-b2bdc89aa00d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:28 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info is being set with open permissions: ugo+rw Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:28 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info Nov 02 10:54:28 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:28 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Deleted volume successfully. Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-bd343c2a-9375-4ec0-93be-8fa18e0d8548-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-652f7fdc-2ea4-417f-87e6-2a51b33b20ff tempest-VolumesCloneTest-1641674575 None] Lock "cinder-a705ad23-f4b3-4f62-af25-775e20b6cc40-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "cinder-bd343c2a-9375-4ec0-93be-8fa18e0d8548-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Acquiring lock "cinder-quobyte-bd343c2a-9375-4ec0-93be-8fa18e0d8548" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-bd343c2a-9375-4ec0-93be-8fa18e0d8548" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa59ea-541f-42aa-8934-eef0ad616b26]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:29 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.info" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.357s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,created_at=2026-11-02T09:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1858447417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,host='devstack@QuobyteHD#QuobyteHD',id=9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:13Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b53f23f-202b-45c0-b20d-5750e3b606c4),volume_type_id=7b53f23f-202b-45c0-b20d-5750e3b606c4)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Creating volume 9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d 1073741824 Nov 02 10:54:29 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a2a01700-6182-45db-8673-217dc6ea4e9f tempest-VolumesDeleteCascade-573767750 None] Create snapshot completed successfully Nov 02 10:54:29 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:29 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548 Nov 02 10:54:29 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d 1073741824" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d Nov 02 10:54:29 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bd343c2a-9375-4ec0-93be-8fa18e0d8548" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "cinder-quobyte-bd343c2a-9375-4ec0-93be-8fa18e0d8548" released by "delete_volume" :: held 0.720s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Created reservations ['c53ed433-a7c4-47dc-8b53-eb63a510bbdc', 'f3d46cc8-a0b6-44a7-9129-6ff009db87a6', '6417e6d3-f308-493f-aa99-88331ddf6a66', '280ac0d0-551c-4754-b95c-e51784aa9786'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:29 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-840439927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1284a7c-2ce1-4203-b569-7bd1fdbb764b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a76d0e6f444b2c8749e4247908ae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:28Z,use_quota=True,user_id='329501b88e384cff871a5391f8c83838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Creating volume d1284a7c-2ce1-4203-b569-7bd1fdbb764b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9db28-8096-4841-9182-921b2fd55725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:29 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b 1073741824 Nov 02 10:54:29 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b04b25c-6824-4e10-9108-fe6b39f9fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Volume volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d (9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d): created successfully Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b04b25c-6824-4e10-9108-fe6b39f9fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (f09b1050-afbd-456f-bc34-dbbb5e339593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c59bf3c3-aac5-4f5c-a538-2cfc6300ab32 tempest-GroupsTest-976077900 None] Created volume successfully. Nov 02 10:54:30 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Deleted volume successfully. Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e5a9a618-7e08-42e9-b1bf-be0edb2ce60a tempest-VolumesCloneTest-1641674575 None] Lock "cinder-bd343c2a-9375-4ec0-93be-8fa18e0d8548-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:30 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b 1073741824" returned: 0 in 0.586s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:30 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b Nov 02 10:54:30 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (d3bc52c1-cba4-4f71-8e5a-9197cfbe8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a21aa6-fec1-4204-97a8-e8ad8bc8a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a21aa6-fec1-4204-97a8-e8ad8bc8a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1545069236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b59980c-4017-4cd6-adb8-83b72a2d1527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb4f1378af4a6591d71fc52973f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e1ccb09-07bf-414e-aa2c-95b19a21240d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:30Z,use_quota=True,user_id='b47d23864dde44aaa6d84dc31d6b84cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4daea82-db83-4cd3-97c1-ba1f7f7a45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4daea82-db83-4cd3-97c1-ba1f7f7a45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30a56a7-579e-4b45-b278-6ad225192702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30a56a7-579e-4b45-b278-6ad225192702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b59980c-4017-4cd6-adb8-83b72a2d1527', 'volume_name': 'volume-2b59980c-4017-4cd6-adb8-83b72a2d1527', 'volume_size': 1, 'snapshot_id': '1e1ccb09-07bf-414e-aa2c-95b19a21240d'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b92afe8-1ffe-486d-9af2-ffcc301a15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b92afe8-1ffe-486d-9af2-ffcc301a15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81c869a-b27d-4913-8091-ac207972bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Volume 2b59980c-4017-4cd6-adb8-83b72a2d1527: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b59980c-4017-4cd6-adb8-83b72a2d1527', 'volume_size': 1, 'snapshot_id': '1e1ccb09-07bf-414e-aa2c-95b19a21240d'} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:30 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" returned: 0 in 0.300s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.170s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d-2b59980c-4017-4cd6-adb8-83b72a2d1527" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c63f5a7-15e8-44e7-a0eb-364cf63ca499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd32507-f244-4a62-9b0f-d161865c104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d-2b59980c-4017-4cd6-adb8-83b72a2d1527" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Creating volume 2b59980c-4017-4cd6-adb8-83b72a2d1527 from snapshot 1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Volume volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b (d1284a7c-2ce1-4203-b569-7bd1fdbb764b): created successfully Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd32507-f244-4a62-9b0f-d161865c104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Flow 'volume_create_manager' (7c25a089-a081-4c15-8ebd-716b14f8b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] snapshot: 1e1ccb09-07bf-414e-aa2c-95b19a21240d, volume: 2b59980c-4017-4cd6-adb8-83b72a2d1527, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-76da1b1f-1e02-4a41-a9ea-0c5908e87165 tempest-VolumesNegativeTest-1231761867 None] Created volume successfully. Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc32d96-cdb3-403e-a8dc-800f529b595b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:31 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:31 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (64b5498f-4f77-4c70-81b6-224154d5a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846a3d97-bf20-4b2a-9a3b-d035ec65ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846a3d97-bf20-4b2a-9a3b-d035ec65ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797099924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,host='devstack@QuobyteHD#QuobyteHD',id=f3a91c88-5307-4f7a-a0c3-acde69c405ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:31Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b53f23f-202b-45c0-b20d-5750e3b606c4),volume_type_id=7b53f23f-202b-45c0-b20d-5750e3b606c4)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b9bcd0-1981-4075-bd61-19431b4ee089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b9bcd0-1981-4075-bd61-19431b4ee089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1ffe8f-bb40-4cdb-8657-4b56cbf124c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1ffe8f-bb40-4cdb-8657-4b56cbf124c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a91c88-5307-4f7a-a0c3-acde69c405ab', 'volume_name': 'volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4708dad3-9006-4e32-a5e3-c75edd50670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4708dad3-9006-4e32-a5e3-c75edd50670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d5c01a-ecfc-4dfb-98fd-1a993f74f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Volume f3a91c88-5307-4f7a-a0c3-acde69c405ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab', 'volume_size': 1} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:31 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.623s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a2d39-cbbf-4a0c-9115-379c9303d883]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:31 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:31 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:31 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:54:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:54:32 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:54:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:32 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 Nov 02 10:54:32 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Flow 'volume_create_manager' (7ebc1a50-e1cb-4914-83a2-43f4f30028d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a870cd11-f7b2-4f46-a2b4-11af5974f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a870cd11-f7b2-4f46-a2b4-11af5974f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-926130066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640367f8-80b2-4385-87a2-1890ede9605f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa013733ee5c4348bfcd89597c9c6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='ec2d5b772b434bffa670309ce8eb8e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6aa8d-6342-4347-8cd7-549214a3be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6aa8d-6342-4347-8cd7-549214a3be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e4dfc0-0480-41df-bd94-e12299d02a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e4dfc0-0480-41df-bd94-e12299d02a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640367f8-80b2-4385-87a2-1890ede9605f', 'volume_name': 'volume-640367f8-80b2-4385-87a2-1890ede9605f', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8d177e-38f4-44e4-811f-65ca1f6b7e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8d177e-38f4-44e4-811f-65ca1f6b7e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe69b10-c559-4fe4-b0c5-3f9afca6b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Volume 640367f8-80b2-4385-87a2-1890ede9605f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640367f8-80b2-4385-87a2-1890ede9605f', 'volume_size': 2} Nov 02 10:54:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527" returned: 0 in 8.554s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:54:40 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Converted 1024.00 MB image at 119.70 MB/s Nov 02 10:54:40 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 is being set with open permissions: ugo+rw Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:40 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 Nov 02 10:54:40 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" released by "_copy_volume_from_snapshot" :: held 9.958s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d-2b59980c-4017-4cd6-adb8-83b72a2d1527" released by "_create_volume_from_snapshot" :: held 10.053s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.086s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.485s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,created_at=2026-11-02T09:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797099924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee09f6e9-367c-45ed-a5ff-88baf6ec1899,host='devstack@QuobyteHD#QuobyteHD',id=f3a91c88-5307-4f7a-a0c3-acde69c405ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aab2935702c40ab9efa98abb3129d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:31Z,use_quota=True,user_id='08423da0e8324e09b1b48a4c004d390a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b53f23f-202b-45c0-b20d-5750e3b606c4),volume_type_id=7b53f23f-202b-45c0-b20d-5750e3b606c4)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Creating volume f3a91c88-5307-4f7a-a0c3-acde69c405ab {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:40 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab 1073741824 Nov 02 10:54:40 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81c869a-b27d-4913-8091-ac207972bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b59980c-4017-4cd6-adb8-83b72a2d1527', 'volume_size': 1, 'snapshot_id': '1e1ccb09-07bf-414e-aa2c-95b19a21240d'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467a06bd-f664-41cb-bb35-d4ac55c1ae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Volume volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 (2b59980c-4017-4cd6-adb8-83b72a2d1527): created successfully Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467a06bd-f664-41cb-bb35-d4ac55c1ae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Flow 'volume_create_manager' (d3bc52c1-cba4-4f71-8e5a-9197cfbe8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-781def8e-165f-432b-a7e0-b420011dda53 tempest-VolumesDeleteCascade-573767750 None] Created volume successfully. Nov 02 10:54:41 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab 1073741824" returned: 0 in 0.731s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:41 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:41 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Performing cascade delete. {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-1e1ccb09-07bf-414e-aa2c-95b19a21240d-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-1e1ccb09-07bf-414e-aa2c-95b19a21240d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Deleting offline snapshot 1e1ccb09-07bf-414e-aa2c-95b19a21240d of volume f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] snapshot_file for this snap is: volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4713fc5f-9302-4c3c-80d8-a98b35fb8016]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:42 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab" returned: 0 in 0.714s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.257s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-926130066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640367f8-80b2-4385-87a2-1890ede9605f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa013733ee5c4348bfcd89597c9c6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:37Z,use_quota=True,user_id='ec2d5b772b434bffa670309ce8eb8e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Creating volume 640367f8-80b2-4385-87a2-1890ede9605f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f 2147483648 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=63,cinder:UPDATE=66,cinder:INSERT=15,cinder:DELETE=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:42 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f 2147483648 Nov 02 10:54:42 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d5c01a-ecfc-4dfb-98fd-1a993f74f925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfdffc9-4c59-4d1f-a0ef-edcb4d3129db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Volume volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab (f3a91c88-5307-4f7a-a0c3-acde69c405ab): created successfully Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfdffc9-4c59-4d1f-a0ef-edcb4d3129db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Flow 'volume_create_manager' (64b5498f-4f77-4c70-81b6-224154d5a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8f37a16c-7b0d-4a6c-a01d-ac4bede96d70 tempest-GroupsTest-976077900 None] Created volume successfully. Nov 02 10:54:42 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.690s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff4d470-729e-4b63-b8c8-3aeb3c2537e9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:42 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:42 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f 2147483648" returned: 0 in 0.809s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=63,cinder:UPDATE=72,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f Nov 02 10:54:43 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.747s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-22bd4e37-a58d-4069-a5e6-d726d50913ea tempest-GroupsTest-976077900 None] Update group completed successfully. Nov 02 10:54:43 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:43 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:43 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe69b10-c559-4fe4-b0c5-3f9afca6b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640367f8-80b2-4385-87a2-1890ede9605f', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d317d1b4-4d5b-4f27-b142-ff0ddca3677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Volume volume-640367f8-80b2-4385-87a2-1890ede9605f (640367f8-80b2-4385-87a2-1890ede9605f): created successfully Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d317d1b4-4d5b-4f27-b142-ff0ddca3677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Flow 'volume_create_manager' (7ebc1a50-e1cb-4914-83a2-43f4f30028d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b4790b7-adef-44d1-bff2-6417561ea4d7 tempest-VolumesCloneNegativeTest-348091731 None] Created volume successfully. Nov 02 10:54:44 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d Nov 02 10:54:44 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:44 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7.1e1ccb09-07bf-414e-aa2c-95b19a21240d" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-1e1ccb09-07bf-414e-aa2c-95b19a21240d" released by "_delete_snapshot" :: held 2.370s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" released by "delete_snapshot" :: held 2.396s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['6e8faa83-c9f2-49a5-b4ef-0406b1c4e4cc', 'd61f074d-ad13-4421-bddb-6af9544958af', 'f2b476a8-1e23-4930-b7f6-033417f4b90b', '0742edfb-bf20-4ea1-a734-1b08b41aff6f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Delete snapshot completed successfully. Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-1e1ccb09-07bf-414e-aa2c-95b19a21240d-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Snapshots deleted, issuing volume delete {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efdce56-7100-4114-aaf3-c7699679f190]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:44 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:44 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Acquiring lock "cinder-640367f8-80b2-4385-87a2-1890ede9605f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "cinder-640367f8-80b2-4385-87a2-1890ede9605f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Acquiring lock "cinder-quobyte-640367f8-80b2-4385-87a2-1890ede9605f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ccfc54b0-3ec9-4347-a30a-a434f0732516 tempest-GroupsTest-976077900 None] Update group completed successfully. Nov 02 10:54:45 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "cinder-quobyte-640367f8-80b2-4385-87a2-1890ede9605f" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.594s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1ed5c-1a86-4191-af15-ef05bcf93486]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7 Nov 02 10:54:45 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f Nov 02 10:54:45 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:45 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" returned: 0 in 0.487s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7" released by "delete_volume" :: held 1.210s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['d959fe4c-fea2-4f02-98f8-c0f100d42357', '1318f8bc-3594-43d5-9b48-d18dcaac8aa1', 'dfa3d143-9aa3-44cd-95ad-9f133c3dd0a4', 'd62f92cd-75df-4200-b8ba-4a11e6b18c44'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:45 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:45 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f Nov 02 10:54:45 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:46 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-640367f8-80b2-4385-87a2-1890ede9605f" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "cinder-quobyte-640367f8-80b2-4385-87a2-1890ede9605f" released by "delete_volume" :: held 1.031s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Acquiring lock "cinder-quobyte-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:46 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Deleted volume successfully. Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f833b9-f2d4-4d3e-a15e-96b4d7e6f2b1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8e5f750-ef6f-48ed-89d7-0310e1b1e475 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-f0ac76aa-bf19-4eb4-8288-d225ba58e4c7-delete_volume" released by "delete_volume" :: held 4.699s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Created reservations ['fb6aa02f-8f8c-48a3-bb20-d6247ef4db88', '9e673680-afaf-48a7-9ca2-c30671db263c', 'aa92df33-f480-4766-a993-2a994894dfc2', '164efb57-b1e0-4e7f-8ccb-5aefedd2d395'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:46 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d Nov 02 10:54:46 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:46 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-2b59980c-4017-4cd6-adb8-83b72a2d1527-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-2b59980c-4017-4cd6-adb8-83b72a2d1527-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa2de9-a19a-400f-81c7-3ac9581d3210]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:46 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d Nov 02 10:54:46 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:46 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Deleted volume successfully. Nov 02 10:54:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-871c3110-ef08-4645-8874-67b834e83c4c tempest-VolumesCloneNegativeTest-348091731 None] Lock "cinder-640367f8-80b2-4385-87a2-1890ede9605f-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:46 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 Nov 02 10:54:46 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-9ac37d48-4f4e-4ebd-aec2-71f9fc64d56d" released by "delete_volume" :: held 0.801s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Acquiring lock "cinder-quobyte-f3a91c88-5307-4f7a-a0c3-acde69c405ab" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-f3a91c88-5307-4f7a-a0c3-acde69c405ab" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc1d4cc-76a9-422d-8416-b7aa6a1cbd23]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527 Nov 02 10:54:47 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab Nov 02 10:54:47 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2b59980c-4017-4cd6-adb8-83b72a2d1527" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-quobyte-2b59980c-4017-4cd6-adb8-83b72a2d1527" released by "delete_volume" :: held 0.744s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Created reservations ['5f4d904a-6c88-4c5c-9705-3882916f2258', '82e8642b-1203-47cc-8ecb-ae33d110acff', 'a54f12e9-178b-45d9-978b-d6341270dbf6', '563bb5ab-139f-4537-8c60-b51e52535ae9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:47 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab Nov 02 10:54:47 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:47 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:47 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:47 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3a91c88-5307-4f7a-a0c3-acde69c405ab" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "cinder-quobyte-f3a91c88-5307-4f7a-a0c3-acde69c405ab" released by "delete_volume" :: held 0.813s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:48 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Deleted volume successfully. Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Created reservations ['52ccf777-e1bb-458d-a91e-715e89078ddb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbbda0f4-822a-4bbd-beba-402e931c90e8 tempest-VolumesDeleteCascade-573767750 None] Lock "cinder-2b59980c-4017-4cd6-adb8-83b72a2d1527-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1530779758 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1530779758, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:54:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1530779758 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1530779758, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Created reservations ['e0053409-8b8b-4a40-a67a-d4ea2398c478', 'fb6a6171-03ca-4db6-8892-d772912e6911', 'f59742bf-5c5c-41e2-b3f6-7367785dce56', 'a22ffddb-4e74-482b-aacf-550ad58818dd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Created reservations ['5075b86d-4e66-46ef-a31a-12fe92d59501', '9c67331c-5aa8-44fa-8792-c8a8e528f226', 'ba24a63c-e551-47ff-8e70-ee8866476818', 'ddb1a2f0-c696-43a6-b3cb-a6e4457c5b51'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:48 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:48 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:48 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e30605a1-5e9a-4bdc-a196-782f2e42fa37 tempest-GroupsTest-976077900 None] Delete group completed successfully. Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (1d4fc549-b98c-444e-af71-368bd54e6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fa281-cdfe-464e-b557-9796e3a3605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432fa281-cdfe-464e-b557-9796e3a3605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-234410125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51644cbf-c3ee-433b-b63b-7d9b7c449625,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:53Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf37556-ed1f-457e-9b47-7d3410fbf3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf37556-ed1f-457e-9b47-7d3410fbf3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c7841e-dd63-4b77-9ea4-135a182e5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c7841e-dd63-4b77-9ea4-135a182e5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51644cbf-c3ee-433b-b63b-7d9b7c449625', 'volume_name': 'volume-51644cbf-c3ee-433b-b63b-7d9b7c449625', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6e0d6f-427d-428a-b1fb-0e937badcb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6e0d6f-427d-428a-b1fb-0e937badcb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc732cd0-6097-471f-96b0-cfaf105f5dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Volume 51644cbf-c3ee-433b-b63b-7d9b7c449625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51644cbf-c3ee-433b-b63b-7d9b7c449625', 'volume_size': 1} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-234410125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51644cbf-c3ee-433b-b63b-7d9b7c449625,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:53Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Creating volume 51644cbf-c3ee-433b-b63b-7d9b7c449625 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:53 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 1073741824 Nov 02 10:54:53 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:54 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 1073741824" returned: 0 in 0.500s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:54 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 Nov 02 10:54:54 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:54 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc732cd0-6097-471f-96b0-cfaf105f5dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51644cbf-c3ee-433b-b63b-7d9b7c449625', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dee5cf-4c0b-4654-a7ac-dacbf31bab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Volume volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 (51644cbf-c3ee-433b-b63b-7d9b7c449625): created successfully Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dee5cf-4c0b-4654-a7ac-dacbf31bab93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (1d4fc549-b98c-444e-af71-368bd54e6397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cc76b9fa-a2bd-40b4-949b-e5278ba88ef5 tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:54:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (4014e9e6-4470-40be-923a-8012dbe9d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4c1cf0-bd37-47db-aadd-538c8bd6b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Acquiring lock "cinder-d1284a7c-2ce1-4203-b569-7bd1fdbb764b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4c1cf0-bd37-47db-aadd-538c8bd6b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2067417964',display_name='tempest-VolumesGetTest-Volume-240248836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7285467a-62ee-4905-932c-69fd9866c0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:57Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dd7533-3690-4278-a3ac-0598d6098b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dd7533-3690-4278-a3ac-0598d6098b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bc8c1e-944e-4979-ad3a-2f9de964a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87bc8c1e-944e-4979-ad3a-2f9de964a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7285467a-62ee-4905-932c-69fd9866c0aa', 'volume_name': 'volume-7285467a-62ee-4905-932c-69fd9866c0aa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6a10e-5dbd-42a1-85fd-8f079b85c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6a10e-5dbd-42a1-85fd-8f079b85c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfa0bb-4f27-4d97-b168-6bae13e5a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Volume 7285467a-62ee-4905-932c-69fd9866c0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7285467a-62ee-4905-932c-69fd9866c0aa', 'volume_size': 1} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2067417964',display_name='tempest-VolumesGetTest-Volume-240248836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7285467a-62ee-4905-932c-69fd9866c0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:57Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Creating volume 7285467a-62ee-4905-932c-69fd9866c0aa {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:57 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "cinder-d1284a7c-2ce1-4203-b569-7bd1fdbb764b-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:57 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa 1073741824 Nov 02 10:54:57 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Acquiring lock "cinder-quobyte-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "cinder-quobyte-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[217fb825-abee-4862-8360-291fef20f8e2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b Nov 02 10:54:57 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa 1073741824" returned: 0 in 0.602s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:57 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa Nov 02 10:54:57 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:57 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b Nov 02 10:54:57 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cfa0bb-4f27-4d97-b168-6bae13e5a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7285467a-62ee-4905-932c-69fd9866c0aa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead29cbf-50b2-459a-98a2-b77176141d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Volume volume-7285467a-62ee-4905-932c-69fd9866c0aa (7285467a-62ee-4905-932c-69fd9866c0aa): created successfully Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead29cbf-50b2-459a-98a2-b77176141d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (4014e9e6-4470-40be-923a-8012dbe9d70c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "cinder-quobyte-d1284a7c-2ce1-4203-b569-7bd1fdbb764b" released by "delete_volume" :: held 0.935s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-41e1c2ee-b4dc-4ef6-b596-3c3e0f6635c9 tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Created reservations ['1d3dc0d6-0c56-4a87-b98c-8ca32517e328', 'af8b91b5-e0d0-4d34-b797-6a81d7951ba3', '1d129b66-0fd8-4f09-bd69-2931e9344dd5', '5a66e3d4-10ce-49d8-b79b-2201c4c22b93'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:58 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:54:58 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (56845565-0980-476e-8a62-ecbc7ad5ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21d5a27-6475-4eb8-917a-afb9811ebd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21d5a27-6475-4eb8-917a-afb9811ebd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121666845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a4e46a-4c28-48c3-9d81-d6ad0078abdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:58Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305a87f-f9d6-41dd-9ed5-3ee5f99c0eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305a87f-f9d6-41dd-9ed5-3ee5f99c0eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70face-2690-49da-b672-82de014e05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70face-2690-49da-b672-82de014e05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a4e46a-4c28-48c3-9d81-d6ad0078abdb', 'volume_name': 'volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96487183-6649-42e2-80c0-8e6120ed3319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96487183-6649-42e2-80c0-8e6120ed3319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfc961c-bf47-4182-94f4-d131134fbfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Volume 74a4e46a-4c28-48c3-9d81-d6ad0078abdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb', 'volume_size': 1} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121666845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a4e46a-4c28-48c3-9d81-d6ad0078abdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:54:58Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Creating volume 74a4e46a-4c28-48c3-9d81-d6ad0078abdb {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:54:58 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Deleted volume successfully. Nov 02 10:54:58 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb 1073741824 Nov 02 10:54:58 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ee57dab-a991-439c-a277-73866410aca4 tempest-VolumesNegativeTest-1231761867 None] Lock "cinder-d1284a7c-2ce1-4203-b569-7bd1fdbb764b-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:54:59 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb 1073741824" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb Nov 02 10:54:59 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-7285467a-62ee-4905-932c-69fd9866c0aa-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "cinder-7285467a-62ee-4905-932c-69fd9866c0aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-7285467a-62ee-4905-932c-69fd9866c0aa" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-7285467a-62ee-4905-932c-69fd9866c0aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007a747-399d-45d3-baf3-e90ef9bd1ccb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa Nov 02 10:54:59 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" returned: 0 in 0.333s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfc961c-bf47-4182-94f4-d131134fbfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddbaebd-93d7-4814-aa81-df08909057b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:54:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Volume volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb (74a4e46a-4c28-48c3-9d81-d6ad0078abdb): created successfully Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddbaebd-93d7-4814-aa81-df08909057b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (56845565-0980-476e-8a62-ecbc7ad5ea75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:54:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e6953c5c-f1f0-4c3e-a186-b299b700a2dd tempest-VolumesListTestJSON-1881220210 None] Created volume successfully. Nov 02 10:54:59 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:54:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:54:59 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa Nov 02 10:54:59 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:00 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-7285467a-62ee-4905-932c-69fd9866c0aa" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-7285467a-62ee-4905-932c-69fd9866c0aa" released by "delete_volume" :: held 0.792s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Created reservations ['37b1c33f-f434-41a0-8d6a-ab26ae9be85b', '35802af6-221c-4e95-9a4d-963c6abf0854', '109957f1-f318-4830-9bb5-04414049c6c0', 'd6f1c075-c910-447d-a4db-95abbd1a0bff'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:00 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:00 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:00 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-51644cbf-c3ee-433b-b63b-7d9b7c449625-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "cinder-51644cbf-c3ee-433b-b63b-7d9b7c449625-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-668d9d62-4eff-41d1-897e-e72d4454c47c tempest-VolumesGetTest-1577545715 None] Lock "cinder-7285467a-62ee-4905-932c-69fd9866c0aa-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-51644cbf-c3ee-433b-b63b-7d9b7c449625" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-51644cbf-c3ee-433b-b63b-7d9b7c449625" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ae0dda-e425-4bf7-97e0-aff1a18053fb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:00 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 Nov 02 10:55:00 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:01 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:01 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625 Nov 02 10:55:01 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:01 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-51644cbf-c3ee-433b-b63b-7d9b7c449625" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-51644cbf-c3ee-433b-b63b-7d9b7c449625" released by "delete_volume" :: held 0.892s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (e6ce26a9-7080-41ad-a016-ee0ac5aed527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57833407-e8a7-4849-8ae9-50d825e89654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57833407-e8a7-4849-8ae9-50d825e89654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-866063816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534638a4-1a47-44da-a579-fd184d6e105e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161a102a-29a4-40ad-be71-8d849926371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (161a102a-29a4-40ad-be71-8d849926371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf57dd38-5f30-42ee-87f4-18faf29241b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf57dd38-5f30-42ee-87f4-18faf29241b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534638a4-1a47-44da-a579-fd184d6e105e', 'volume_name': 'volume-534638a4-1a47-44da-a579-fd184d6e105e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7575ff9c-a3cc-4500-a14b-76d454728a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7575ff9c-a3cc-4500-a14b-76d454728a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397d3022-7e2a-432f-818c-42f32380c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Volume 534638a4-1a47-44da-a579-fd184d6e105e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534638a4-1a47-44da-a579-fd184d6e105e', 'volume_size': 1} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-866063816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534638a4-1a47-44da-a579-fd184d6e105e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:01Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Creating volume 534638a4-1a47-44da-a579-fd184d6e105e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:01 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e 1073741824 Nov 02 10:55:01 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Created reservations ['90a4b660-b57e-411f-beb4-a28071f10ce8', '6891a7df-f282-43ee-8229-f7029c439c30', '066252bd-bc7d-4df5-b984-b75641abf5c4', '08c1fba2-00ad-4207-b59d-837fd2a975bb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:01 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:01 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3402a07c-45da-4b58-baf6-4123185b3973 tempest-VolumesGetTest-1577545715 None] Lock "cinder-51644cbf-c3ee-433b-b63b-7d9b7c449625-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:02 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e 1073741824" returned: 0 in 0.581s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:02 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e Nov 02 10:55:02 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:02 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397d3022-7e2a-432f-818c-42f32380c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534638a4-1a47-44da-a579-fd184d6e105e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48f0bb4-4413-4ed4-ba67-1cf7626ae26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Volume volume-534638a4-1a47-44da-a579-fd184d6e105e (534638a4-1a47-44da-a579-fd184d6e105e): created successfully Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48f0bb4-4413-4ed4-ba67-1cf7626ae26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (e6ce26a9-7080-41ad-a016-ee0ac5aed527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6e26fb2c-dc69-4eb8-aff5-4fff9cc487f3 tempest-VolumesListTestJSON-1881220210 None] Created volume successfully. Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (5aa65e1a-c059-4806-a107-f89b61533714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b483b-a9ca-42c9-8422-c0c97dc1da64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b483b-a9ca-42c9-8422-c0c97dc1da64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1968761712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273f3520-5403-4c40-98ec-8fcb7c316acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:04Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc2c9cb-0090-40ca-b25a-0653bc4ecae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc2c9cb-0090-40ca-b25a-0653bc4ecae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bc0d2b-0704-4c38-ae7c-7fc8fc3096d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54bc0d2b-0704-4c38-ae7c-7fc8fc3096d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '273f3520-5403-4c40-98ec-8fcb7c316acd', 'volume_name': 'volume-273f3520-5403-4c40-98ec-8fcb7c316acd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f095b1d-bd71-44c1-b20a-aa22ff68a9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f095b1d-bd71-44c1-b20a-aa22ff68a9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1837a6f7-c8b3-4722-a25f-abcc2bb2abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Volume 273f3520-5403-4c40-98ec-8fcb7c316acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-273f3520-5403-4c40-98ec-8fcb7c316acd', 'volume_size': 1} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1968761712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273f3520-5403-4c40-98ec-8fcb7c316acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:04Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Creating volume 273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:03 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd 1073741824 Nov 02 10:55:03 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd 1073741824" returned: 0 in 0.625s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (53520f77-e96a-4081-9f2e-1de05185f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a0d325-3715-40b8-a64d-bc45cdd5dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a0d325-3715-40b8-a64d-bc45cdd5dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-90370385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50a485b-650c-4784-9f98-8fd6d0564721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:04Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:04 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c731a7-1203-4e0a-95fe-c9c9b546d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c731a7-1203-4e0a-95fe-c9c9b546d02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a79e8c-21bb-401b-9d53-24309ec56d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a79e8c-21bb-401b-9d53-24309ec56d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50a485b-650c-4784-9f98-8fd6d0564721', 'volume_name': 'volume-d50a485b-650c-4784-9f98-8fd6d0564721', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50162c0-d993-441d-b534-675f2e92babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50162c0-d993-441d-b534-675f2e92babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe6672c-9a9d-4489-af5e-d7ff28b618fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Volume d50a485b-650c-4784-9f98-8fd6d0564721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50a485b-650c-4784-9f98-8fd6d0564721', 'volume_size': 1} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:04 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-90370385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50a485b-650c-4784-9f98-8fd6d0564721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2ebdf66143f457f9e3d6a9817d0ddf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:04Z,use_quota=True,user_id='2177aab7b7bf42dcb05f1e26578cac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Creating volume d50a485b-650c-4784-9f98-8fd6d0564721 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:04 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 1073741824 Nov 02 10:55:04 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1837a6f7-c8b3-4722-a25f-abcc2bb2abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273f3520-5403-4c40-98ec-8fcb7c316acd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16440c2c-84cc-4741-9d05-e03add0a7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Volume volume-273f3520-5403-4c40-98ec-8fcb7c316acd (273f3520-5403-4c40-98ec-8fcb7c316acd): created successfully Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16440c2c-84cc-4741-9d05-e03add0a7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (5aa65e1a-c059-4806-a107-f89b61533714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5f0e7fb3-59ef-47d2-b9a2-f7b3d2662cf2 tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:55:05 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 1073741824" returned: 0 in 0.576s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:05 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 Nov 02 10:55:05 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:05 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe6672c-9a9d-4489-af5e-d7ff28b618fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50a485b-650c-4784-9f98-8fd6d0564721', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acb8fa4-29c5-4282-b53d-aa2da2cb0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Volume volume-d50a485b-650c-4784-9f98-8fd6d0564721 (d50a485b-650c-4784-9f98-8fd6d0564721): created successfully Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acb8fa4-29c5-4282-b53d-aa2da2cb0a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Flow 'volume_create_manager' (53520f77-e96a-4081-9f2e-1de05185f47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6772448e-44c3-447a-ba8e-3608f36e1719 tempest-VolumesListTestJSON-1881220210 None] Created volume successfully. Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (2494f7d1-49b9-46c5-8e18-b9d7f5028d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f7c3a1-87f1-47ef-b969-d6cf99079fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f7c3a1-87f1-47ef-b969-d6cf99079fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946250277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3967659-42d2-4d68-9b3e-a827d77f958c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=273f3520-5403-4c40-98ec-8fcb7c316acd,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:06Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df7814b-7c90-446a-b682-22192ce645c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df7814b-7c90-446a-b682-22192ce645c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edb1471-6851-4ee4-ab0e-ea29459a039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edb1471-6851-4ee4-ab0e-ea29459a039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f3967659-42d2-4d68-9b3e-a827d77f958c', 'volume_name': 'volume-f3967659-42d2-4d68-9b3e-a827d77f958c', 'volume_size': 1, 'source_volid': '273f3520-5403-4c40-98ec-8fcb7c316acd', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dec6e6-c703-4649-b355-a73ce6960651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dec6e6-c703-4649-b355-a73ce6960651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa4307-fd25-4a3b-948a-66f8efb324a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Volume f3967659-42d2-4d68-9b3e-a827d77f958c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f3967659-42d2-4d68-9b3e-a827d77f958c', 'volume_size': 1, 'source_volid': '273f3520-5403-4c40-98ec-8fcb7c316acd', 'source_volstatus': 'available'} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:06 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Cloning volume 273f3520-5403-4c40-98ec-8fcb7c316acd to volume f3967659-42d2-4d68-9b3e-a827d77f958c Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Creating offline snapshot 6948ba9d-ad8e-4b7d-8994-e53549262873 of volume 273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e818eb5-4160-4041-b03b-62fe7e66734f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:06 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:06 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 1G Nov 02 10:55:07 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:07 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 1G" returned: 0 in 0.626s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273f3520-5403-4c40-98ec-8fcb7c316acd -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:07 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273f3520-5403-4c40-98ec-8fcb7c316acd -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:07 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273f3520-5403-4c40-98ec-8fcb7c316acd -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.498s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 is being set with open permissions: ugo+rw Nov 02 10:55:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:08 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:08 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:08 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:08 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info Nov 02 10:55:08 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:09 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info is being set with open permissions: ugo+rw Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info Nov 02 10:55:09 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.info" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:09 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:09 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] snapshot: 6948ba9d-ad8e-4b7d-8994-e53549262873, volume: f3967659-42d2-4d68-9b3e-a827d77f958c, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[30843eff-ef61-485e-8d2c-81f366889117]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:09 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-d50a485b-650c-4784-9f98-8fd6d0564721-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:10 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-d50a485b-650c-4784-9f98-8fd6d0564721-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-quobyte-d50a485b-650c-4784-9f98-8fd6d0564721" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-d50a485b-650c-4784-9f98-8fd6d0564721" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19bc514-62a6-4194-a46a-28dd00e90c59]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 Nov 02 10:55:10 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.642s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-273f3520-5403-4c40-98ec-8fcb7c316acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f7ef2-82b0-49cb-ac31-aca2075fe595]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:10 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721" returned: 0 in 0.556s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721 Nov 02 10:55:10 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:10 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:10 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c Nov 02 10:55:10 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:11 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d50a485b-650c-4784-9f98-8fd6d0564721" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-d50a485b-650c-4784-9f98-8fd6d0564721" released by "delete_volume" :: held 1.042s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Created reservations ['7edf93f7-a88b-492c-b2da-6616a5c86324', '45b87f63-fd39-4964-bfb3-332d537e6bf1', 'e2970805-711a-41fd-a124-4dc8dbe31bd7', '4dfafe16-8fd6-414c-b79f-c821977a5295'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:11 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:11 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:12 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.764s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Deleted volume successfully. Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c8fee53-5a16-41b5-ac00-c6ac09c7815a tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-d50a485b-650c-4784-9f98-8fd6d0564721-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-534638a4-1a47-44da-a579-fd184d6e105e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-534638a4-1a47-44da-a579-fd184d6e105e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-quobyte-534638a4-1a47-44da-a579-fd184d6e105e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-534638a4-1a47-44da-a579-fd184d6e105e" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf36424-c9d5-48df-80ef-32593e801e62]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e Nov 02 10:55:13 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:13 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e" returned: 0 in 0.747s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:13 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e Nov 02 10:55:13 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:14 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-534638a4-1a47-44da-a579-fd184d6e105e" returned: 0 in 0.572s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-534638a4-1a47-44da-a579-fd184d6e105e" released by "delete_volume" :: held 1.469s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Created reservations ['8df954dc-8ca3-4a51-9db4-e08f833b9530', '97e9e69d-dfae-482c-b00e-4024b8dc26b5', 'c76e6ae7-fca8-4841-8d5a-e6030fb4925c', '344eead0-acb5-40ff-b737-0b17c222e2b6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:14 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:14 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-74a4e46a-4c28-48c3-9d81-d6ad0078abdb-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-74a4e46a-4c28-48c3-9d81-d6ad0078abdb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:15 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.896s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Deleted volume successfully. Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "cinder-quobyte-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff0e52cc-b2ad-4582-9789-4d4fc0bb0a56 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-534638a4-1a47-44da-a579-fd184d6e105e-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" acquired by "delete_volume" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18948b2c-3e5b-4ec8-938f-9c5a30e6ad82]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:16 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb Nov 02 10:55:16 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:16 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" returned: 0 in 0.935s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:16 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb Nov 02 10:55:16 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:17 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" returned: 0 in 0.746s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-quobyte-74a4e46a-4c28-48c3-9d81-d6ad0078abdb" released by "delete_volume" :: held 1.814s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Created reservations ['2a83b47c-0212-4be7-b358-9aa6dbf5224d', '14386789-cc6e-41ac-9ba6-3b6b47373432', 'd2c2c1d1-25b4-483b-992e-d25b27d18942', 'bd9e5b1e-a06d-4be6-89ac-27c86d8da694'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:18 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:18 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:18 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Deleted volume successfully. Nov 02 10:55:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18699e8e-8daf-4281-bfad-cbcfdb141c31 tempest-VolumesListTestJSON-1881220210 None] Lock "cinder-74a4e46a-4c28-48c3-9d81-d6ad0078abdb-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (61e9ea81-3a11-4d74-a0d1-9a74724e6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7714180-90bc-4960-b9fb-85757dfae5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7714180-90bc-4960-b9fb-85757dfae5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1462605199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e698a2-a976-4457-86f8-444c2f66681d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:20Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fd2278-4414-4f52-bd9d-7e49b718f827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fd2278-4414-4f52-bd9d-7e49b718f827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba096b5-b7f5-4dd6-96cc-313b29ac4819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba096b5-b7f5-4dd6-96cc-313b29ac4819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e698a2-a976-4457-86f8-444c2f66681d', 'volume_name': 'volume-f6e698a2-a976-4457-86f8-444c2f66681d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5866ff1-a8bb-4a3c-9a69-259f637d78f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5866ff1-a8bb-4a3c-9a69-259f637d78f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23817cb2-d75e-4447-82bb-af05c4f5c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Volume f6e698a2-a976-4457-86f8-444c2f66681d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e698a2-a976-4457-86f8-444c2f66681d', 'volume_size': 1} Nov 02 10:55:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:20 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c" returned: 0 in 9.186s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:55:20 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Converted 1024.00 MB image at 111.46 MB/s Nov 02 10:55:20 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c is being set with open permissions: ugo+rw Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:20 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c Nov 02 10:55:20 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:20 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" released by "_copy_volume_from_snapshot" :: held 10.674s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-6948ba9d-ad8e-4b7d-8994-e53549262873" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-6948ba9d-ad8e-4b7d-8994-e53549262873" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Deleting offline snapshot 6948ba9d-ad8e-4b7d-8994-e53549262873 of volume 273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] snapshot_file for this snap is: volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660c15d-7880-444c-91d4-7940e9f61642]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:20 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:20 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:20 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.445s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-273f3520-5403-4c40-98ec-8fcb7c316acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb46348-4a4a-4ede-b8fc-9a3384350b79]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:20 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Flow 'volume_create_manager' (3a4f6c58-2121-48e8-b7ff-782cb7f6c91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a40c19-c126-4d51-9af8-e3f5a52b1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a40c19-c126-4d51-9af8-e3f5a52b1e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1066635027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55176ec-c822-4ea5-b621-e0086e5092ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f818d301a64bd78fd4fcd5733a6f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:21Z,use_quota=True,user_id='15296dc94d844d558bcfab19d443ce90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df411a8b-c8ac-4a40-b607-676de9e8bf87),volume_type_id=df411a8b-c8ac-4a40-b607-676de9e8bf87)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46ba858-4181-4b2d-a281-c614a3698f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46ba858-4181-4b2d-a281-c614a3698f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa50311-7867-4cf4-aab4-8b2ae6abd66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa50311-7867-4cf4-aab4-8b2ae6abd66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55176ec-c822-4ea5-b621-e0086e5092ba', 'volume_name': 'volume-c55176ec-c822-4ea5-b621-e0086e5092ba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:21 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:21 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc9564e-4553-406c-8677-14fa29f1d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc9564e-4553-406c-8677-14fa29f1d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b32193-c5e3-40e9-909e-1d76ac482e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Volume c55176ec-c822-4ea5-b621-e0086e5092ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55176ec-c822-4ea5-b621-e0086e5092ba', 'volume_size': 1} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:21 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:21 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:21 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:21 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:21 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873 Nov 02 10:55:21 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd.6948ba9d-ad8e-4b7d-8994-e53549262873" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-6948ba9d-ad8e-4b7d-8994-e53549262873" released by "_delete_snapshot" :: held 1.713s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.571s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1462605199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e698a2-a976-4457-86f8-444c2f66681d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:20Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Creating volume f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:22 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d 1073741824 Nov 02 10:55:22 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fa4307-fd25-4a3b-948a-66f8efb324a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3967659-42d2-4d68-9b3e-a827d77f958c', 'volume_size': 1, 'source_volid': '273f3520-5403-4c40-98ec-8fcb7c316acd', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c030f-ddf4-4c01-9690-a45026e0a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Volume volume-f3967659-42d2-4d68-9b3e-a827d77f958c (f3967659-42d2-4d68-9b3e-a827d77f958c): created successfully Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c030f-ddf4-4c01-9690-a45026e0a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (2494f7d1-49b9-46c5-8e18-b9d7f5028d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-519d9820-1c58-4973-ac7a-0cb43076d80a tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:55:22 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d 1073741824" returned: 0 in 0.521s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:22 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d Nov 02 10:55:22 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:22 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1066635027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55176ec-c822-4ea5-b621-e0086e5092ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45f818d301a64bd78fd4fcd5733a6f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:21Z,use_quota=True,user_id='15296dc94d844d558bcfab19d443ce90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df411a8b-c8ac-4a40-b607-676de9e8bf87),volume_type_id=df411a8b-c8ac-4a40-b607-676de9e8bf87)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Creating volume c55176ec-c822-4ea5-b621-e0086e5092ba {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23817cb2-d75e-4447-82bb-af05c4f5c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e698a2-a976-4457-86f8-444c2f66681d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba 1073741824 Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40939305-a922-486c-ae59-fca8663c3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:23 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Volume volume-f6e698a2-a976-4457-86f8-444c2f66681d (f6e698a2-a976-4457-86f8-444c2f66681d): created successfully Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40939305-a922-486c-ae59-fca8663c3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (61e9ea81-3a11-4d74-a0d1-9a74724e6df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0fd5a5fd-14e1-43d6-b506-7c7bf1c6175c tempest-VolumesSnapshotTestJSON-1627136301 None] Created volume successfully. Nov 02 10:55:23 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba 1073741824" returned: 0 in 0.498s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:23 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba Nov 02 10:55:23 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:23 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b32193-c5e3-40e9-909e-1d76ac482e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55176ec-c822-4ea5-b621-e0086e5092ba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef700fdb-4d2d-492f-8434-bef72f68bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Volume volume-c55176ec-c822-4ea5-b621-e0086e5092ba (c55176ec-c822-4ea5-b621-e0086e5092ba): created successfully Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef700fdb-4d2d-492f-8434-bef72f68bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Flow 'volume_create_manager' (3a4f6c58-2121-48e8-b7ff-782cb7f6c91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ee7a99cc-f890-44b2-b35b-0b732e814419 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Created volume successfully. Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Flow 'volume_create_manager' (13c922d5-f3f0-487f-83af-cee7a253ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c8af3b-68c1-4541-89b1-8b569acdfe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c8af3b-68c1-4541-89b1-8b569acdfe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-329609055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cfd28b-839a-4d65-b997-817ee0d73a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf060855ac994e73b0afe9405f2ca150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='403bb2c1b89048f98470dde7ecace7ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433fb20-971b-47c3-a1bb-cd6787874b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433fb20-971b-47c3-a1bb-cd6787874b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8195dff4-a92b-4895-bdbf-cb605365c821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8195dff4-a92b-4895-bdbf-cb605365c821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cfd28b-839a-4d65-b997-817ee0d73a62', 'volume_name': 'volume-b1cfd28b-839a-4d65-b997-817ee0d73a62', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7351e49-6d35-48ea-98cf-d5424f8f988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7351e49-6d35-48ea-98cf-d5424f8f988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9cd403-e8cb-42b0-9b99-8a96f67b8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Volume b1cfd28b-839a-4d65-b997-817ee0d73a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cfd28b-839a-4d65-b997-817ee0d73a62', 'volume_size': 2} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-329609055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cfd28b-839a-4d65-b997-817ee0d73a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf060855ac994e73b0afe9405f2ca150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='403bb2c1b89048f98470dde7ecace7ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Creating volume b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 2147483648 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 2147483648 Nov 02 10:55:24 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (e552712d-1890-4fed-a624-7e90a07038da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1223607-61b9-4291-b04d-ad8f5a435375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1223607-61b9-4291-b04d-ad8f5a435375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290668027',display_name='tempest-VolumesGetTest-Volume-432946995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0a0e59-64b8-4dab-af09-0869a3629d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e29f440-b63e-49c2-b0e6-694558f64dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e29f440-b63e-49c2-b0e6-694558f64dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba23122-ba6c-49a7-9015-b716d26beddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba23122-ba6c-49a7-9015-b716d26beddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0a0e59-64b8-4dab-af09-0869a3629d5d', 'volume_name': 'volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af57e1-35d4-42ba-9508-8141581b18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af57e1-35d4-42ba-9508-8141581b18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad59b5c8-b7e9-4b50-885c-0d7234a1c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Volume ea0a0e59-64b8-4dab-af09-0869a3629d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d', 'volume_size': 1} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:24 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 2147483648" returned: 0 in 0.579s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:24 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 Nov 02 10:55:24 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:24 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1e3d7787-a150-4644-b877-6326c1f1bd64 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Retype volume completed successfully. Nov 02 10:55:25 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290668027',display_name='tempest-VolumesGetTest-Volume-432946995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0a0e59-64b8-4dab-af09-0869a3629d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:24Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Creating volume ea0a0e59-64b8-4dab-af09-0869a3629d5d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:25 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9cd403-e8cb-42b0-9b99-8a96f67b8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cfd28b-839a-4d65-b997-817ee0d73a62', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:25 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d 1073741824 Nov 02 10:55:25 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67506db4-22c3-4ca0-8124-07cfa611471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Volume volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 (b1cfd28b-839a-4d65-b997-817ee0d73a62): created successfully Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67506db4-22c3-4ca0-8124-07cfa611471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Flow 'volume_create_manager' (13c922d5-f3f0-487f-83af-cee7a253ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-257fc124-d441-44f8-8b18-5b50ea19839c tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Created volume successfully. Nov 02 10:55:25 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d 1073741824" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d Nov 02 10:55:25 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.173s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad59b5c8-b7e9-4b50-885c-0d7234a1c98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a94b12-4fed-4b70-988e-618b3340bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Creating offline snapshot 774a3521-4ff9-4aef-9ba3-ec39c5541120 of volume f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Volume volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d (ea0a0e59-64b8-4dab-af09-0869a3629d5d): created successfully Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a94b12-4fed-4b70-988e-618b3340bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (e552712d-1890-4fed-a624-7e90a07038da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a6260-9791-4c1a-83da-20adbb7942f9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d50be429-f086-4324-9efe-7fb524ead1d5 tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:55:25 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d Nov 02 10:55:25 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "cinder-c55176ec-c822-4ea5-b621-e0086e5092ba-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "cinder-c55176ec-c822-4ea5-b621-e0086e5092ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "cinder-quobyte-c55176ec-c822-4ea5-b621-e0086e5092ba" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "cinder-quobyte-c55176ec-c822-4ea5-b621-e0086e5092ba" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65add3d-21e4-4d70-b7a4-dbc8e6befcca]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba Nov 02 10:55:26 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 1G Nov 02 10:55:26 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-ea0a0e59-64b8-4dab-af09-0869a3629d5d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "cinder-ea0a0e59-64b8-4dab-af09-0869a3629d5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-ea0a0e59-64b8-4dab-af09-0869a3629d5d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:26 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-ea0a0e59-64b8-4dab-af09-0869a3629d5d" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4176142-279b-4a31-bb8c-e250af284097]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba Nov 02 10:55:26 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d Nov 02 10:55:26 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 1G" returned: 0 in 0.477s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e698a2-a976-4457-86f8-444c2f66681d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e698a2-a976-4457-86f8-444c2f66681d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 Nov 02 10:55:26 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:26 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c55176ec-c822-4ea5-b621-e0086e5092ba" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "cinder-quobyte-c55176ec-c822-4ea5-b621-e0086e5092ba" released by "delete_volume" :: held 0.819s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:26 devstack cinder-volume[86783]: WARNING cinder.quota [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:55:26 devstack cinder-volume[86783]: WARNING cinder.quota [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Created reservations ['5a20c748-1b54-4e17-9d02-981152174702', '526ca023-d054-4a78-82cf-b831e3f64d5c', '9f1cb701-7280-42bb-a58f-3413571ce396', '6db97371-7d73-4917-ac9e-de102fbbe64a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:26 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:26 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d Nov 02 10:55:27 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e698a2-a976-4457-86f8-444c2f66681d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 is being set with open permissions: ugo+rw Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 Nov 02 10:55:27 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ea0a0e59-64b8-4dab-af09-0869a3629d5d" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.308s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-ea0a0e59-64b8-4dab-af09-0869a3629d5d" released by "delete_volume" :: held 0.729s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Deleted volume successfully. Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a98fb0d8-d462-4d23-b1d4-ce08114ad028 tempest-VolumeRetypeWithoutMigrationTest-1700693560 None] Lock "cinder-c55176ec-c822-4ea5-b621-e0086e5092ba-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Created reservations ['e350658c-378c-4223-9566-1a42202a7b52', '0eeea05b-0c8d-48f3-a903-2e5f2d2e9a61', '0623264f-9f86-4917-b279-9f0def77a2aa', '5f1c2dbd-9204-424a-8f80-049ddcfdc6ed'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:27 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info Nov 02 10:55:27 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-f3967659-42d2-4d68-9b3e-a827d77f958c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "cinder-f3967659-42d2-4d68-9b3e-a827d77f958c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd02744-6764-4f89-9687-0e4e2ce9d098 tempest-VolumesGetTest-1577545715 None] Lock "cinder-ea0a0e59-64b8-4dab-af09-0869a3629d5d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:27 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:27 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info is being set with open permissions: ugo+rw Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:27 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info Nov 02 10:55:27 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[732b3b27-ab8a-4e93-b46a-54a699547659]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c Nov 02 10:55:28 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.info" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.778s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Creating offline snapshot 77380cd9-b954-450d-a22f-9413cff36a18 of volume b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f82ad5d-dc87-4793-80e1-941bf4bf6c38]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-43147a76-2210-48f8-8b42-116f8dc6c95e tempest-VolumesSnapshotTestJSON-1627136301 None] Create snapshot completed successfully Nov 02 10:55:28 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 Nov 02 10:55:28 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c Nov 02 10:55:28 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3967659-42d2-4d68-9b3e-a827d77f958c" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-f3967659-42d2-4d68-9b3e-a827d77f958c" released by "delete_volume" :: held 0.714s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:28 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 2G Nov 02 10:55:28 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Created reservations ['4c640caa-8bd6-450e-81cf-fe9495dc4ffd', '4564f5fb-ebf5-4cf6-89af-4f58a35667a2', 'acc6e634-840a-4c2e-9054-81457c1ffc4d', 'fd769ac4-4636-4602-9cf7-aae34e0fc381'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:28 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:28 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-774a3521-4ff9-4aef-9ba3-ec39c5541120-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-774a3521-4ff9-4aef-9ba3-ec39c5541120-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-774a3521-4ff9-4aef-9ba3-ec39c5541120" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-774a3521-4ff9-4aef-9ba3-ec39c5541120" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Deleting offline snapshot 774a3521-4ff9-4aef-9ba3-ec39c5541120 of volume f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] snapshot_file for this snap is: volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-273f3520-5403-4c40-98ec-8fcb7c316acd-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e05f5e0-6542-422f-8043-2f4dab23cdd1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "cinder-273f3520-5403-4c40-98ec-8fcb7c316acd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-273f3520-5403-4c40-98ec-8fcb7c316acd" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-273f3520-5403-4c40-98ec-8fcb7c316acd" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:29 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:29 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 2G" returned: 0 in 0.704s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb8a48-044b-42c3-8c5a-6cecf473f6d6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:29 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 Nov 02 10:55:29 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5812dab-ab18-4159-9a21-2785931cdfb4 tempest-VolumesGetTest-1577545715 None] Lock "cinder-f3967659-42d2-4d68-9b3e-a827d77f958c-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:29 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:29 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120" returned: 0 in 0.552s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6e698a2-a976-4457-86f8-444c2f66681d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a781a-ad0d-4195-b38f-8eb01b9cecf6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 is being set with open permissions: ugo+rw Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 Nov 02 10:55:29 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:29 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd Nov 02 10:55:29 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:29 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d Nov 02 10:55:29 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-273f3520-5403-4c40-98ec-8fcb7c316acd" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-273f3520-5403-4c40-98ec-8fcb7c316acd" released by "delete_volume" :: held 0.899s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info Nov 02 10:55:30 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Created reservations ['eda1c934-e15c-4013-8230-9a66fba103ff', '6d819efd-88b2-4c36-9b4e-e551d74d3245', 'b9cc4ce3-6510-43b9-a029-6b51437c169d', '8234e534-10ad-4c73-a394-40d4d1548c46'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d" returned: 0 in 0.512s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 Nov 02 10:55:30 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:30 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info is being set with open permissions: ugo+rw Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info Nov 02 10:55:30 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:30 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120 Nov 02 10:55:30 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:30 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a8a01ef9-05d7-4897-bc8f-175f278b58ac tempest-VolumesGetTest-1577545715 None] Lock "cinder-273f3520-5403-4c40-98ec-8fcb7c316acd-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:30 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.info" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2a0752c2-1a6f-4436-8225-1f4105864802 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Create snapshot completed successfully Nov 02 10:55:30 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d.774a3521-4ff9-4aef-9ba3-ec39c5541120" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-774a3521-4ff9-4aef-9ba3-ec39c5541120" released by "_delete_snapshot" :: held 1.964s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" released by "delete_snapshot" :: held 1.994s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['d81f762c-f2f0-4873-add5-bb95ea66a9d1', 'e6183a5c-edcc-4794-994d-fcc7fbd0df06', 'cc091772-3a82-4ea2-ad59-212afde6f715', 'e98bbd5d-f137-41e0-aaaf-9f65e3f65193'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Delete snapshot completed successfully. Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b95b9ee-ecfc-470b-8820-38704ddd075f tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-774a3521-4ff9-4aef-9ba3-ec39c5541120-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "cinder-77380cd9-b954-450d-a22f-9413cff36a18-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-77380cd9-b954-450d-a22f-9413cff36a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "cinder-quobyte-77380cd9-b954-450d-a22f-9413cff36a18" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-77380cd9-b954-450d-a22f-9413cff36a18" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Deleting offline snapshot 77380cd9-b954-450d-a22f-9413cff36a18 of volume b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] snapshot_file for this snap is: volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c8e0c-c266-4c01-b880-77a6463946c8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:31 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 Nov 02 10:55:31 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (427fe9da-0d3e-4a81-8ab7-bf37466e048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fd86d4-b5a0-4447-9fdc-436edb9ed70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fd86d4-b5a0-4447-9fdc-436edb9ed70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2092566392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda70bb0-bd91-48ce-a753-8d73504c7c69,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:32Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1645694c-0ed5-40bd-941a-ce33f62b4b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1645694c-0ed5-40bd-941a-ce33f62b4b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610344f2-b715-4138-b8b6-20fbadda14d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:55:32 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1cfd28b-839a-4d65-b997-817ee0d73a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d92fcc8-8b32-416c-9ca9-d78b3d2c3803]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 Nov 02 10:55:32 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610344f2-b715-4138-b8b6-20fbadda14d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eda70bb0-bd91-48ce-a753-8d73504c7c69', 'volume_name': 'volume-eda70bb0-bd91-48ce-a753-8d73504c7c69', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140c0aae-fcc6-40dd-9fe4-e8f9cc353939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140c0aae-fcc6-40dd-9fe4-e8f9cc353939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1b348-5b55-4838-b5f3-d7537d3ce1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Volume eda70bb0-bd91-48ce-a753-8d73504c7c69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eda70bb0-bd91-48ce-a753-8d73504c7c69', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Trying to clone eda70bb0-bd91-48ce-a753-8d73504c7c69 from image 134ee211-162c-468b-b66a-c0628be004d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (28a8ca1e-8af1-4c6e-8d42-20e1e0b4ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619ba83d-8687-4129-9b73-f3f0a9b4b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62" returned: 0 in 0.507s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619ba83d-8687-4129-9b73-f3f0a9b4b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1663606018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89167ce6-1963-4b33-aae2-1fc2f815496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:33Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4e721-e851-43cd-938f-b56c6a1a0475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4e721-e851-43cd-938f-b56c6a1a0475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:32 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61562132-0e42-4d97-ac65-fcdab91ff99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:32 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61562132-0e42-4d97-ac65-fcdab91ff99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89167ce6-1963-4b33-aae2-1fc2f815496d', 'volume_name': 'volume-89167ce6-1963-4b33-aae2-1fc2f815496d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97103fbc-c52f-4a65-985b-43b490d743c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97103fbc-c52f-4a65-985b-43b490d743c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3f6db4-fdb6-4c6a-9094-53c99651e6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Volume 89167ce6-1963-4b33-aae2-1fc2f815496d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89167ce6-1963-4b33-aae2-1fc2f815496d', 'volume_size': 1} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1663606018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89167ce6-1963-4b33-aae2-1fc2f815496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:33Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Creating volume 89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:33 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d 1073741824 Nov 02 10:55:33 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:55:33 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9240d-d116-4d72-980e-f41f4df74e7b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18 Nov 02 10:55:33 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD Nov 02 10:55:33 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d 1073741824" returned: 0 in 0.643s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 is fetched for user d3cc5c945e6b45898ccfcdf4ed218a42. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:55:33 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:33 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:33 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62.77380cd9-b954-450d-a22f-9413cff36a18" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[80757d34-8029-4e0c-979f-d9b5955b793c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-77380cd9-b954-450d-a22f-9413cff36a18" released by "_delete_snapshot" :: held 2.106s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" released by "delete_snapshot" :: held 2.141s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Created reservations ['f3611bcc-73a1-4d8f-98f5-49a077c637eb', '1965fa7d-1cdc-432e-b6d2-9fcd4193f791', '5fff6f6a-04a7-4f39-86f7-45362f08a2a1', 'f2973928-6a2b-4f54-8f35-00e284cd0a25'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:34 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD Nov 02 10:55:34 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3f6db4-fdb6-4c6a-9094-53c99651e6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89167ce6-1963-4b33-aae2-1fc2f815496d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00923748-89fb-485c-aa81-1a7d6de79c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Delete snapshot completed successfully. Nov 02 10:55:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Volume volume-89167ce6-1963-4b33-aae2-1fc2f815496d (89167ce6-1963-4b33-aae2-1fc2f815496d): created successfully Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00923748-89fb-485c-aa81-1a7d6de79c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (28a8ca1e-8af1-4c6e-8d42-20e1e0b4ace7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-985b7714-b38b-44a9-a1ed-5b083538975f tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-77380cd9-b954-450d-a22f-9413cff36a18-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5b1f681d-5fbd-45b5-99ab-d23b1f9799df tempest-VolumesSnapshotTestJSON-1627136301 None] Created volume successfully. Nov 02 10:55:34 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2092566392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda70bb0-bd91-48ce-a753-8d73504c7c69,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:32Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Creating volume eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1073741824 Nov 02 10:55:34 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1073741824" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Flow 'volume_create_manager' (8b61548a-c134-40e5-8117-cef65b167aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ca053e-8318-4ec0-ab6d-0e0d4e8853d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ca053e-8318-4ec0-ab6d-0e0d4e8853d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1230972209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c62fff6-62b1-42f2-97cb-dcc9124104f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51df83510dfb4f0c967c61603455f2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:35Z,use_quota=True,user_id='f1655107049e46aa92c2e4d9e3829389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27dac75-c275-4b07-9398-df2e16227ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27dac75-c275-4b07-9398-df2e16227ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 Nov 02 10:55:34 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ca0d5b-1e0f-4392-bf44-ed4ef0a73c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ca0d5b-1e0f-4392-bf44-ed4ef0a73c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c62fff6-62b1-42f2-97cb-dcc9124104f0', 'volume_name': 'volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b2299c-2b30-48b7-982d-c6a50d0d3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b2299c-2b30-48b7-982d-c6a50d0d3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76719e6c-8614-46d1-968a-4343ca37fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Volume 4c62fff6-62b1-42f2-97cb-dcc9124104f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0', 'volume_size': 1} Nov 02 10:55:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "cinder-b1cfd28b-839a-4d65-b997-817ee0d73a62-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-b1cfd28b-839a-4d65-b997-817ee0d73a62-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:35 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69" returned: 0 in 0.341s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1230972209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c62fff6-62b1-42f2-97cb-dcc9124104f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51df83510dfb4f0c967c61603455f2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:35Z,use_quota=True,user_id='f1655107049e46aa92c2e4d9e3829389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Creating volume 4c62fff6-62b1-42f2-97cb-dcc9124104f0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[537915a2-d6d0-49d5-b507-21436dacca65]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 1073741824 Nov 02 10:55:35 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Attempting download of 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume eda70bb0-bd91-48ce-a753-8d73504c7c69. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36dc503-523d-47ae-9fdb-36829aa7ccc1]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 Nov 02 10:55:35 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv Nov 02 10:55:35 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62 Nov 02 10:55:35 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 1073741824" returned: 0 in 0.527s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv Nov 02 10:55:35 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:35 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 Nov 02 10:55:35 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:35 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1cfd28b-839a-4d65-b997-817ee0d73a62" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-quobyte-b1cfd28b-839a-4d65-b997-817ee0d73a62" released by "delete_volume" :: held 0.752s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Created reservations ['8aec7a6b-db86-4330-8b31-ac0e4ccad76f', '8549042b-48f5-47df-bb5e-c13accff7f7f', '9c9635f9-6282-4a3f-8bb3-cbedfd9b36da', '8c9091b4-2eba-4362-b91c-0b22a649cd92'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:35 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv" returned: 1 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_rs979nwv' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65a65c-b9c8-4643-ba72-b3531df67716]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:36 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.943s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:36 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:36 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76719e6c-8614-46d1-968a-4343ca37fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d981cb4-1328-4040-9b5b-1235b74c1cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Creating offline snapshot cbff83c5-df4a-4d7f-a32f-2e61033bfa1b of volume 89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:55:36 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD Nov 02 10:55:36 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Volume volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 (4c62fff6-62b1-42f2-97cb-dcc9124104f0): created successfully Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d981cb4-1328-4040-9b5b-1235b74c1cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Flow 'volume_create_manager' (8b61548a-c134-40e5-8117-cef65b167aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d5623-8128-4a8f-864a-a1374d13008e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a60b9261-5783-4e30-8194-946b75c9e334 tempest-VolumesServicesTestJSON-1450938906 None] Created volume successfully. Nov 02 10:55:36 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:36 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Deleted volume successfully. Nov 02 10:55:36 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] 134ee211-162c-468b-b66a-c0628be004d6 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d85be6cc-b63b-4af7-b580-bad0de7e2256 tempest-VolumesSnapshotNegativeTestJSON-539126180 None] Lock "cinder-b1cfd28b-839a-4d65-b997-817ee0d73a62-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:36 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 Nov 02 10:55:36 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:36 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:36 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b 1G Nov 02 10:55:36 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Acquiring lock "cinder-4c62fff6-62b1-42f2-97cb-dcc9124104f0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b 1G" returned: 0 in 0.556s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89167ce6-1963-4b33-aae2-1fc2f815496d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89167ce6-1963-4b33-aae2-1fc2f815496d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:37 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "cinder-4c62fff6-62b1-42f2-97cb-dcc9124104f0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Acquiring lock "cinder-quobyte-4c62fff6-62b1-42f2-97cb-dcc9124104f0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "cinder-quobyte-4c62fff6-62b1-42f2-97cb-dcc9124104f0" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30460c-59a1-451d-badf-d40fea601da2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 Nov 02 10:55:37 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89167ce6-1963-4b33-aae2-1fc2f815496d -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.499s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b is being set with open permissions: ugo+rw Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:37 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0" returned: 0 in 0.541s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:37 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0 Nov 02 10:55:37 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:37 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info Nov 02 10:55:38 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4c62fff6-62b1-42f2-97cb-dcc9124104f0" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "cinder-quobyte-4c62fff6-62b1-42f2-97cb-dcc9124104f0" released by "delete_volume" :: held 0.961s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Created reservations ['d900eb88-c6a2-413b-bf4c-33da73ce7656', 'f4ba6e32-df8a-4629-b613-5f4080640e18', 'd29ba4c4-d701-41dc-ba1e-fe0e6617d67a', 'd3a337e2-98c2-4f41-b081-c2aca5f2bae6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:38 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info" returned: 0 in 0.403s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info is being set with open permissions: ugo+rw Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info Nov 02 10:55:38 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:38 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.info" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69" returned: 0 in 2.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_a6t7e36cdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:55:38 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Converted 112.00 MB image at 44.92 MB/s Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:38 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1G Nov 02 10:55:38 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Deleted volume successfully. Nov 02 10:55:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-477e20c0-2177-4590-b34b-4df6906804be tempest-VolumesSnapshotTestJSON-1627136301 None] Create snapshot completed successfully Nov 02 10:55:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4a7cb756-9f17-42cd-9a66-66eb6b3147bb tempest-VolumesServicesTestJSON-1450938906 None] Lock "cinder-4c62fff6-62b1-42f2-97cb-dcc9124104f0-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:39 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 1G" returned: 0 in 0.320s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Downloaded image 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume eda70bb0-bd91-48ce-a753-8d73504c7c69 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 for user d3cc5c945e6b45898ccfcdf4ed218a42 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Marking volume eda70bb0-bd91-48ce-a753-8d73504c7c69 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Copying metadata from image 134ee211-162c-468b-b66a-c0628be004d6 to eda70bb0-bd91-48ce-a753-8d73504c7c69. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Creating volume glance metadata for volume eda70bb0-bd91-48ce-a753-8d73504c7c69 backed by image 134ee211-162c-468b-b66a-c0628be004d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e1b348-5b55-4838-b5f3-d7537d3ce1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda70bb0-bd91-48ce-a753-8d73504c7c69', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28169eac-666c-4f16-b41b-3f020e9da18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:39 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Volume volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 (eda70bb0-bd91-48ce-a753-8d73504c7c69): created successfully Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28169eac-666c-4f16-b41b-3f020e9da18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (427fe9da-0d3e-4a81-8ab7-bf37466e048c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d344c42a-9b03-406f-9163-d5ba8c9a580a tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (fef66e33-be4f-4cfc-a4a4-33e340558092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41b2e38-70c1-4b3d-8067-829045f47c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41b2e38-70c1-4b3d-8067-829045f47c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1007404260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866840cf-ce35-4dbd-8863-9df897eb6a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cbff83c5-df4a-4d7f-a32f-2e61033bfa1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:40Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6498f6-69fd-4548-96b5-2432c3e4095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6498f6-69fd-4548-96b5-2432c3e4095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd9dd2-03b4-4533-b88e-efef06e9ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd9dd2-03b4-4533-b88e-efef06e9ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '866840cf-ce35-4dbd-8863-9df897eb6a21', 'volume_name': 'volume-866840cf-ce35-4dbd-8863-9df897eb6a21', 'volume_size': 2, 'snapshot_id': 'cbff83c5-df4a-4d7f-a32f-2e61033bfa1b'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8b478d-3a99-4d32-aac1-bd0f6ecf63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8b478d-3a99-4d32-aac1-bd0f6ecf63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9efbb94-715e-4905-a547-809dad5ee484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Volume 866840cf-ce35-4dbd-8863-9df897eb6a21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-866840cf-ce35-4dbd-8863-9df897eb6a21', 'volume_size': 2, 'snapshot_id': 'cbff83c5-df4a-4d7f-a32f-2e61033bfa1b'} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-866840cf-ce35-4dbd-8863-9df897eb6a21" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-866840cf-ce35-4dbd-8863-9df897eb6a21" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Creating volume 866840cf-ce35-4dbd-8863-9df897eb6a21 from snapshot cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] snapshot: cbff83c5-df4a-4d7f-a32f-2e61033bfa1b, volume: 866840cf-ce35-4dbd-8863-9df897eb6a21, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451ba9f-6beb-4b35-855c-94b1c74e33c4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:40 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:40 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (ea49faa8-6426-4340-a5b9-c85d986cc594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be240eb-5418-4b88-ad14-67349181ec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be240eb-5418-4b88-ad14-67349181ec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-633094615',display_name='tempest-VolumesGetTest-Volume-253215121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352fb601-eb0b-451f-8ba5-65bb336dcb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:41Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f26099-face-4eb8-8e5c-84239f138e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f26099-face-4eb8-8e5c-84239f138e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8841bb-c907-4ab4-a559-61e2fb9004a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8841bb-c907-4ab4-a559-61e2fb9004a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352fb601-eb0b-451f-8ba5-65bb336dcb12', 'volume_name': 'volume-352fb601-eb0b-451f-8ba5-65bb336dcb12', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baa1902-5eb7-41e6-8bac-1458d1dc3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baa1902-5eb7-41e6-8bac-1458d1dc3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c55dbf-4145-4ad2-ad63-da59ba94d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Volume 352fb601-eb0b-451f-8ba5-65bb336dcb12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352fb601-eb0b-451f-8ba5-65bb336dcb12', 'volume_size': 1} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.580s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89167ce6-1963-4b33-aae2-1fc2f815496d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047b8ff-4c5d-4570-af34-60d73567ea3a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:41 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:41 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:41 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:55:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:55:41 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:55:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:41 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 Nov 02 10:55:41 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21" returned: 0 in 8.016s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:55:49 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Converted 1024.00 MB image at 127.73 MB/s Nov 02 10:55:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 is being set with open permissions: ugo+rw Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 Nov 02 10:55:49 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" released by "_copy_volume_from_snapshot" :: held 9.442s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=218,cinder:SELECT=181,cinder:DELETE=17,cinder:INSERT=53 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=212,cinder:SELECT=164,cinder:INSERT=61,cinder:DELETE=16 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-866840cf-ce35-4dbd-8863-9df897eb6a21" released by "_create_volume_from_snapshot" :: held 9.559s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.586s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.855s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-633094615',display_name='tempest-VolumesGetTest-Volume-253215121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352fb601-eb0b-451f-8ba5-65bb336dcb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece17340575c48b489b287eaede9856c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:41Z,use_quota=True,user_id='d3cc5c945e6b45898ccfcdf4ed218a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Creating volume 352fb601-eb0b-451f-8ba5-65bb336dcb12 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:49 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 1073741824 Nov 02 10:55:49 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9efbb94-715e-4905-a547-809dad5ee484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866840cf-ce35-4dbd-8863-9df897eb6a21', 'volume_size': 2, 'snapshot_id': 'cbff83c5-df4a-4d7f-a32f-2e61033bfa1b'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beb938a-4074-4320-ab34-057f8179e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Volume volume-866840cf-ce35-4dbd-8863-9df897eb6a21 (866840cf-ce35-4dbd-8863-9df897eb6a21): created successfully Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beb938a-4074-4320-ab34-057f8179e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (fef66e33-be4f-4cfc-a4a4-33e340558092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ca432a84-920f-49c7-ab05-44017a0f19af tempest-VolumesSnapshotTestJSON-1627136301 None] Created volume successfully. Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-866840cf-ce35-4dbd-8863-9df897eb6a21-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-866840cf-ce35-4dbd-8863-9df897eb6a21-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5731221-2f95-439d-b012-8da8b5a8cf3d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 Nov 02 10:55:50 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 1073741824" returned: 0 in 0.694s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 Nov 02 10:55:50 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:50 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21 Nov 02 10:55:50 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:50 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12" returned: 0 in 0.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c55dbf-4145-4ad2-ad63-da59ba94d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352fb601-eb0b-451f-8ba5-65bb336dcb12', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33d2fba-4404-4b7f-a6c5-94bad703ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Volume volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 (352fb601-eb0b-451f-8ba5-65bb336dcb12): created successfully Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33d2fba-4404-4b7f-a6c5-94bad703ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Flow 'volume_create_manager' (ea49faa8-6426-4340-a5b9-c85d986cc594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c686f549-aea8-44ce-8cc5-1e1d321ee133 tempest-VolumesGetTest-1577545715 None] Created volume successfully. Nov 02 10:55:51 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-866840cf-ce35-4dbd-8863-9df897eb6a21" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-866840cf-ce35-4dbd-8863-9df897eb6a21" released by "delete_volume" :: held 0.887s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['86463933-32bd-40e4-bb8e-a0b6fe0572ba', '733c3053-4094-48ed-93f8-96dd7b10218f', '50e917d9-2607-47ac-972f-df7c0158c5d7', '38fa2de1-a7c3-4cc0-a885-4d07e65a47ac'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:51 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Deleting offline snapshot cbff83c5-df4a-4d7f-a32f-2e61033bfa1b of volume 89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] snapshot_file for this snap is: volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ebf1d-25f4-4d0b-8d83-2025c29e9c15]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:51 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Deleted volume successfully. Nov 02 10:55:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c356b4e-4632-402e-840a-933233ef915b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-866840cf-ce35-4dbd-8863-9df897eb6a21-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:51 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:51 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-352fb601-eb0b-451f-8ba5-65bb336dcb12-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "cinder-352fb601-eb0b-451f-8ba5-65bb336dcb12-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-352fb601-eb0b-451f-8ba5-65bb336dcb12" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-352fb601-eb0b-451f-8ba5-65bb336dcb12" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a19866-e0ef-483a-b571-2884d809a4be]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.671s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89167ce6-1963-4b33-aae2-1fc2f815496d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[587cbc55-1e2e-4f1d-bb97-0c43c734d915]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 Nov 02 10:55:52 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:52 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:52 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12" returned: 0 in 0.621s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:52 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12 Nov 02 10:55:52 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-352fb601-eb0b-451f-8ba5-65bb336dcb12" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-352fb601-eb0b-451f-8ba5-65bb336dcb12" released by "delete_volume" :: held 1.114s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:53 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.918s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:53 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Created reservations ['e976dd93-51cb-4025-9b17-a2dfe5396c2a', '39861256-8d8f-4135-824e-2bb997689bf0', '397d61ca-ab18-4faa-8e87-f7b5e020a003', '0a0a361c-47ce-4dd0-880f-39bc0d0d7e24'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:53 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:53 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0649dcc8-a710-4025-96bf-19c2b652efe8 tempest-VolumesGetTest-1577545715 None] Lock "cinder-352fb601-eb0b-451f-8ba5-65bb336dcb12-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:53 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.588s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:53 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b Nov 02 10:55:53 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:54 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d.cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b" released by "_delete_snapshot" :: held 2.640s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" released by "delete_snapshot" :: held 2.668s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['cd25669e-aa3d-4ea2-b937-9aa58ac6f3b3', '8a8df3ae-70d5-4fb6-994d-961c9ea4adf2', '820698b6-7b0b-41f9-b7e8-91365cdc2131', '30d269ce-1879-4287-adc9-368cdf289126'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Delete snapshot completed successfully. Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-18b9c193-d34d-487d-bbf6-eacecc9731dd tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-cbff83c5-df4a-4d7f-a32f-2e61033bfa1b-delete_snapshot" released by "delete_snapshot" :: held 2.902s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-eda70bb0-bd91-48ce-a753-8d73504c7c69-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "cinder-eda70bb0-bd91-48ce-a753-8d73504c7c69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Acquiring lock "cinder-quobyte-eda70bb0-bd91-48ce-a753-8d73504c7c69" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-eda70bb0-bd91-48ce-a753-8d73504c7c69" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9721594-31ad-446a-9331-40c7830ce3df]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:54 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 Nov 02 10:55:54 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-89167ce6-1963-4b33-aae2-1fc2f815496d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-89167ce6-1963-4b33-aae2-1fc2f815496d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:55 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:55:55 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69 Nov 02 10:55:55 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c93fb8-63fb-41cb-9150-ef6b36af6eba]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:55 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-eda70bb0-bd91-48ce-a753-8d73504c7c69" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "cinder-quobyte-eda70bb0-bd91-48ce-a753-8d73504c7c69" released by "delete_volume" :: held 0.950s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Created reservations ['96d5ce00-be9f-478c-bfa4-da5529894d34', '5fad1412-1be7-4b35-a39b-be3b90183d44', '9a508058-ac40-4aaf-bb8f-2ba0aa281947', '1b3ae34a-ebab-4cd4-8275-cb193d08aad8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:55 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:55 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.681s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:55 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d Nov 02 10:55:55 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Deleted volume successfully. Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-49f262d9-8dc0-4a86-808b-b147a784da00 tempest-VolumesGetTest-1577545715 None] Lock "cinder-eda70bb0-bd91-48ce-a753-8d73504c7c69-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:56 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-89167ce6-1963-4b33-aae2-1fc2f815496d" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-89167ce6-1963-4b33-aae2-1fc2f815496d" released by "delete_volume" :: held 1.126s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['e282ba2e-e119-4ab9-a1f7-7774c326d5e3', 'ab77c6fc-5ae2-43d8-bc31-5ebce4ff01a7', '178d196c-569d-44ac-95f0-8cda5dd335d9', 'eabf8024-a505-47f8-8c21-4ba3a1c5bc21'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:56 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:55:56 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:56 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:55:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Deleted volume successfully. Nov 02 10:55:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2bad1dc7-f01a-4319-bebb-f8ea28fcc44a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-89167ce6-1963-4b33-aae2-1fc2f815496d-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (5e07cf4d-5540-4337-81d9-89eb3904fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeb7e31-87d7-450e-b564-dbd5c7404f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aeb7e31-87d7-450e-b564-dbd5c7404f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2006161228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f90708-2624-40bd-9b26-6a5d7694f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:58Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66edc3d6-d9e9-4051-93a8-9aec2b34c22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66edc3d6-d9e9-4051-93a8-9aec2b34c22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30051459-811d-4611-8639-002ab84c9b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30051459-811d-4611-8639-002ab84c9b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f90708-2624-40bd-9b26-6a5d7694f987', 'volume_name': 'volume-99f90708-2624-40bd-9b26-6a5d7694f987', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d77bab1-b926-42e9-a9f9-c2d41fc51842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d77bab1-b926-42e9-a9f9-c2d41fc51842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cb88e1-2a2a-4abe-8638-7e99563499c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume 99f90708-2624-40bd-9b26-6a5d7694f987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f90708-2624-40bd-9b26-6a5d7694f987', 'volume_size': 1} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2006161228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f90708-2624-40bd-9b26-6a5d7694f987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:55:58Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Creating volume 99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:55:58 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 1073741824 Nov 02 10:55:58 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:58 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 1073741824" returned: 0 in 0.656s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:55:58 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:55:58 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:55:59 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cb88e1-2a2a-4abe-8638-7e99563499c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f90708-2624-40bd-9b26-6a5d7694f987', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95e6d66-4ac0-4846-87a2-797d3f413b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:55:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume volume-99f90708-2624-40bd-9b26-6a5d7694f987 (99f90708-2624-40bd-9b26-6a5d7694f987): created successfully Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95e6d66-4ac0-4846-87a2-797d3f413b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:55:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (5e07cf4d-5540-4337-81d9-89eb3904fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:55:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dbcf7d81-a7cf-4b17-9f88-041ae17a67d0 tempest-VolumesSnapshotTestJSON-1627136301 None] Created volume successfully. Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Creating offline snapshot e848adeb-0ace-4cae-84e3-b871feb9eaf6 of volume 99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cee1fa0-71c9-4d16-aaaa-04f09a240bfe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:00 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:56:00 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:00 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:00 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 1G Nov 02 10:56:00 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 1G" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f90708-2624-40bd-9b26-6a5d7694f987 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:01 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f90708-2624-40bd-9b26-6a5d7694f987 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:01 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:01 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f90708-2624-40bd-9b26-6a5d7694f987 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.422s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:01 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 is being set with open permissions: ugo+rw Nov 02 10:56:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:02 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info Nov 02 10:56:02 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Flow 'volume_create_manager' (0bebc557-bb92-486b-bb86-a7937d685508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d8f80e-5206-442d-80ff-035504f21c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d8f80e-5206-442d-80ff-035504f21c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1531876467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c24959e-a1d9-4064-947c-6dd020b6ef5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8175ba19f6412ebce68510af451704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:02Z,use_quota=True,user_id='e94f824acb0644aebb0e315c3c355423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b0df55-ccc6-4e8e-afc0-33b89025b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b0df55-ccc6-4e8e-afc0-33b89025b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca18834-8762-46d0-b699-68d501369b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca18834-8762-46d0-b699-68d501369b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c24959e-a1d9-4064-947c-6dd020b6ef5e', 'volume_name': 'volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52a22a9-13c6-4d33-a547-0b388d2183dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52a22a9-13c6-4d33-a547-0b388d2183dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e2a1-052a-4a83-9602-0ac2a69c9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e', 'volume_size': 1} Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:02 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:02 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info is being set with open permissions: ugo+rw Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:02 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info Nov 02 10:56:02 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:02 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.info" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1531876467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c24959e-a1d9-4064-947c-6dd020b6ef5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8175ba19f6412ebce68510af451704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:02Z,use_quota=True,user_id='e94f824acb0644aebb0e315c3c355423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Creating volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e 1073741824 Nov 02 10:56:03 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-12d36408-9e1f-47b9-b034-24871e5fdf22 tempest-VolumesSnapshotTestJSON-1627136301 None] Create snapshot completed successfully Nov 02 10:56:03 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e 1073741824" returned: 0 in 0.637s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:03 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e Nov 02 10:56:03 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:04 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e2a1-052a-4a83-9602-0ac2a69c9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c520ef-20c6-483f-8b6b-5058fce69027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Volume volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e (5c24959e-a1d9-4064-947c-6dd020b6ef5e): created successfully Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c520ef-20c6-483f-8b6b-5058fce69027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Flow 'volume_create_manager' (0bebc557-bb92-486b-bb86-a7937d685508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-504e8cb9-c780-441c-82b9-6fb17b30482c tempest-VolumesSnapshotListTestJSON-1951018472 None] Created volume successfully. Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (f6e962a3-8ee4-4a86-8df2-758c2840581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77417b06-8298-415d-b5db-73922b02062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77417b06-8298-415d-b5db-73922b02062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-880229312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a134c0-4244-4f52-b151-5e1e92509838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='124eac04b2c04085807e8cd186201588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e848adeb-0ace-4cae-84e3-b871feb9eaf6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:05Z,use_quota=True,user_id='4f8dbf6e698c44618b4d3393f87c65b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097de1b2-3023-4816-818a-2354c17aaa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097de1b2-3023-4816-818a-2354c17aaa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7a0388-4828-41b5-9482-cc694d0bd1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7a0388-4828-41b5-9482-cc694d0bd1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86a134c0-4244-4f52-b151-5e1e92509838', 'volume_name': 'volume-86a134c0-4244-4f52-b151-5e1e92509838', 'volume_size': 1, 'snapshot_id': 'e848adeb-0ace-4cae-84e3-b871feb9eaf6'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580b5527-42f4-4a22-a010-2573f2e01a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580b5527-42f4-4a22-a010-2573f2e01a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0fd8d5-adf9-488f-a679-cac2308e645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume 86a134c0-4244-4f52-b151-5e1e92509838: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86a134c0-4244-4f52-b151-5e1e92509838', 'volume_size': 1, 'snapshot_id': 'e848adeb-0ace-4cae-84e3-b871feb9eaf6'} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6-86a134c0-4244-4f52-b151-5e1e92509838" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6-86a134c0-4244-4f52-b151-5e1e92509838" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Creating volume 86a134c0-4244-4f52-b151-5e1e92509838 from snapshot e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] snapshot: e848adeb-0ace-4cae-84e3-b871feb9eaf6, volume: 86a134c0-4244-4f52-b151-5e1e92509838, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c26746-f596-4a65-8785-92acdbad8fbf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:05 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:05 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:05 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.595s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99f90708-2624-40bd-9b26-6a5d7694f987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[500013e5-0e30-4211-b01b-c8bfb4b59a36]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:05 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:56:05 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:06 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:56:06 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:56:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:06 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 Nov 02 10:56:06 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:09 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:09 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:10 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.597s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (efd1df9c-96cc-4205-b53c-66c6689713d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b58357-47dd-46e3-8f16-601cd636fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b58357-47dd-46e3-8f16-601cd636fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1059586007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c466e8-9be5-4d9f-af8d-8d135cea7a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:10Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35d4c69-08a9-434b-9017-76be737919a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35d4c69-08a9-434b-9017-76be737919a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa956d0c-8dcb-4bc2-aded-c7b8ac608d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa956d0c-8dcb-4bc2-aded-c7b8ac608d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c466e8-9be5-4d9f-af8d-8d135cea7a8a', 'volume_name': 'volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f51bd00-5d87-4d43-958f-ab0db3e73fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f51bd00-5d87-4d43-958f-ab0db3e73fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10f4ce-c9ef-4636-bd02-b2880a1c103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Volume a4c466e8-9be5-4d9f-af8d-8d135cea7a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a', 'volume_size': 1} Nov 02 10:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:13 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838" returned: 0 in 7.706s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:13 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987, size 1024.00 MB, duration 7.71 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:56:13 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Converted 1024.00 MB image at 132.87 MB/s Nov 02 10:56:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 is being set with open permissions: ugo+rw Nov 02 10:56:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:13 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 Nov 02 10:56:13 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" released by "_copy_volume_from_snapshot" :: held 9.157s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6-86a134c0-4244-4f52-b151-5e1e92509838" released by "_create_volume_from_snapshot" :: held 9.240s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.276s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.073s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Creating offline snapshot 7d9e79d7-442b-4844-b182-8b237c31fea1 of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0fd8d5-adf9-488f-a679-cac2308e645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a134c0-4244-4f52-b151-5e1e92509838', 'volume_size': 1, 'snapshot_id': 'e848adeb-0ace-4cae-84e3-b871feb9eaf6'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d972b82d-f2ac-4930-a4b7-b96259034548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce85e35c-41a1-412c-8b68-93a492f11c1b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Volume volume-86a134c0-4244-4f52-b151-5e1e92509838 (86a134c0-4244-4f52-b151-5e1e92509838): created successfully Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d972b82d-f2ac-4930-a4b7-b96259034548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Flow 'volume_create_manager' (f6e962a3-8ee4-4a86-8df2-758c2840581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7b519162-bcff-482d-8b5a-c852d97019c2 tempest-VolumesSnapshotTestJSON-1627136301 None] Created volume successfully. Nov 02 10:56:14 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e Nov 02 10:56:14 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-86a134c0-4244-4f52-b151-5e1e92509838-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-86a134c0-4244-4f52-b151-5e1e92509838-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:14 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:14 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 1G Nov 02 10:56:14 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c878b42-4ac1-4462-ac4c-8485a54e3211]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:14 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 Nov 02 10:56:14 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 1G" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:15 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838 Nov 02 10:56:15 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-86a134c0-4244-4f52-b151-5e1e92509838" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-86a134c0-4244-4f52-b151-5e1e92509838" released by "delete_volume" :: held 0.769s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:15 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 is being set with open permissions: ugo+rw Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:15 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['a1f583e2-03a9-4b58-b65a-55a11d8f8250', '9966cf4f-837d-41cd-9bd1-e886399c0c63', '8cc20838-bec7-402b-bcf2-0ccfbedb061a', '88b1e5ee-eced-430d-be78-d250a9015c32'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:15 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:15 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:15 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-e848adeb-0ace-4cae-84e3-b871feb9eaf6-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-e848adeb-0ace-4cae-84e3-b871feb9eaf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Deleting offline snapshot e848adeb-0ace-4cae-84e3-b871feb9eaf6 of volume 99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:16 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info Nov 02 10:56:16 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] snapshot_file for this snap is: volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86a848-1feb-42a3-94f0-5e7aa56b8ac0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.410s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Deleted volume successfully. Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc507209-2fc2-48a8-a7f2-1974694c595b tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-86a134c0-4244-4f52-b151-5e1e92509838-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:16 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:16 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info is being set with open permissions: ugo+rw Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info Nov 02 10:56:16 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99f90708-2624-40bd-9b26-6a5d7694f987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0865259-ee26-41c3-9df2-407298854ccc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.info" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1059586007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c466e8-9be5-4d9f-af8d-8d135cea7a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:10Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Creating volume a4c466e8-9be5-4d9f-af8d-8d135cea7a8a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:16 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:56:16 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:16 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a 1073741824 Nov 02 10:56:16 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dcd1e555-cf5e-4df0-9a6f-d465981d3d49 tempest-VolumesSnapshotListTestJSON-1951018472 None] Create snapshot completed successfully Nov 02 10:56:17 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.796s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:17 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a 1073741824" returned: 0 in 0.674s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a Nov 02 10:56:17 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:17 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6 Nov 02 10:56:17 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:17 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" returned: 0 in 0.300s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a10f4ce-c9ef-4636-bd02-b2880a1c103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66913d6-13e6-41ee-a441-289dbc5fa937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Volume volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a (a4c466e8-9be5-4d9f-af8d-8d135cea7a8a): created successfully Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66913d6-13e6-41ee-a441-289dbc5fa937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (efd1df9c-96cc-4205-b53c-66c6689713d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c7b8b5f8-3acd-4c23-a33a-3d92c24e9822 tempest-VolumesListAdminTestJSON-1496151374 None] Created volume successfully. Nov 02 10:56:18 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987.e848adeb-0ace-4cae-84e3-b871feb9eaf6" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-e848adeb-0ace-4cae-84e3-b871feb9eaf6" released by "_delete_snapshot" :: held 2.096s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" released by "delete_snapshot" :: held 2.144s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Creating offline snapshot e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[071b359d-6650-46f1-a60a-f676a6ba280f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['54594fd8-042c-4be3-bc50-748789dfa39a', 'e2207188-50b1-4378-ac1f-b2c238d246e4', 'e196a3c3-7ccb-49b1-bd0c-8147e2658429', '73b42e9b-9f3c-4750-945c-6123dbfb19c5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Delete snapshot completed successfully. Nov 02 10:56:18 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:18 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f20fb58a-db03-4ef3-ad60-a48164f2e084 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-e848adeb-0ace-4cae-84e3-b871feb9eaf6-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:18 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:18 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e 1G Nov 02 10:56:18 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e 1G" returned: 0 in 0.830s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:19 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:19 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-99f90708-2624-40bd-9b26-6a5d7694f987-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-99f90708-2624-40bd-9b26-6a5d7694f987-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" acquired by "delete_volume" :: waited 0.050s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ac258-5210-48bd-93bf-1b54e63cd575]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.711s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e is being set with open permissions: ugo+rw Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:20 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:56:20 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (ee24032b-130f-458f-a71c-e67e4a453a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ace27-c758-4e39-abd9-823b7ae506fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:20 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ace27-c758-4e39-abd9-823b7ae506fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1323509704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad2735-9091-4bdc-803f-98cc2a36b23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:20Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0559e1e9-d4b6-4f1f-be7e-9d03042e8c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0559e1e9-d4b6-4f1f-be7e-9d03042e8c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819602d6-5b5e-4019-bee9-446c9aa63fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819602d6-5b5e-4019-bee9-446c9aa63fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ad2735-9091-4bdc-803f-98cc2a36b23e', 'volume_name': 'volume-47ad2735-9091-4bdc-803f-98cc2a36b23e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78cbeb2-b12a-404c-8dc0-c8566c82b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78cbeb2-b12a-404c-8dc0-c8566c82b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1569c159-2c10-46dc-95b7-c96ccff8281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Volume 47ad2735-9091-4bdc-803f-98cc2a36b23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ad2735-9091-4bdc-803f-98cc2a36b23e', 'volume_size': 1} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1323509704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ad2735-9091-4bdc-803f-98cc2a36b23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:20Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Creating volume 47ad2735-9091-4bdc-803f-98cc2a36b23e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:20 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.839s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2f25db5a-43b8-40bc-8e26-b2d584416432 tempest-VolumesSnapshotListTestJSON-1951018472 None] Create snapshot completed successfully Nov 02 10:56:20 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e 1073741824 Nov 02 10:56:20 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:20 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987 Nov 02 10:56:20 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-99f90708-2624-40bd-9b26-6a5d7694f987" returned: 0 in 0.506s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-99f90708-2624-40bd-9b26-6a5d7694f987" released by "delete_volume" :: held 1.516s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['c46b8cc1-d4cc-467c-8f33-ed9bec1ab5bd', '4b05c8de-df3e-4e1d-a62f-7301d5ea3069', '92a9166f-74af-4b80-a3b2-346216315f3d', '70751c31-f7c7-43f8-a4dd-07f87929f01c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:21 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e 1073741824" returned: 0 in 0.749s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:21 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e Nov 02 10:56:21 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:21 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:21 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:21 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.185s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1569c159-2c10-46dc-95b7-c96ccff8281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ad2735-9091-4bdc-803f-98cc2a36b23e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e6a73-556b-45b9-a449-e76431f0a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Volume volume-47ad2735-9091-4bdc-803f-98cc2a36b23e (47ad2735-9091-4bdc-803f-98cc2a36b23e): created successfully Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e6a73-556b-45b9-a449-e76431f0a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (ee24032b-130f-458f-a71c-e67e4a453a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Creating offline snapshot 67fe5918-b9b7-4514-9728-67ae8a812c7a of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:22 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Deleted volume successfully. Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4187f347-d676-4e15-a8ca-7a5697796e8b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8ad2a6da-d50a-4028-8f2d-0bd440379a93 tempest-VolumesListAdminTestJSON-1496151374 None] Created volume successfully. Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-f6e698a2-a976-4457-86f8-444c2f66681d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9c62a439-3e70-4b15-aab6-4b1f6ebdb24a tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-99f90708-2624-40bd-9b26-6a5d7694f987-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-f6e698a2-a976-4457-86f8-444c2f66681d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:22 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:22 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4813e-c978-4c77-8cb9-c78c60e36a9c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:22 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.628s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:22 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d Nov 02 10:56:22 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a 1G Nov 02 10:56:22 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:22 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:23 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d" returned: 0 in 0.698s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:23 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d Nov 02 10:56:23 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (09ee4baf-9647-43a1-8040-16f643996607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1b12f1-8d92-4b09-af20-8411264b9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1b12f1-8d92-4b09-af20-8411264b9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1905294060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8550c3e2-18d6-463b-a3db-cd5a830f7045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:23Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5d9857-3d4c-4bfe-b5f9-91549b23a1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5d9857-3d4c-4bfe-b5f9-91549b23a1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4b6d09-e946-4a1a-928c-66ec1832431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4b6d09-e946-4a1a-928c-66ec1832431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8550c3e2-18d6-463b-a3db-cd5a830f7045', 'volume_name': 'volume-8550c3e2-18d6-463b-a3db-cd5a830f7045', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ce96c5-1ca6-40ab-a5e8-75e503d39655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ce96c5-1ca6-40ab-a5e8-75e503d39655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b4d15a-386b-4869-99f4-397e907a0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Volume 8550c3e2-18d6-463b-a3db-cd5a830f7045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8550c3e2-18d6-463b-a3db-cd5a830f7045', 'volume_size': 1} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:23 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f6e698a2-a976-4457-86f8-444c2f66681d" returned: 0 in 0.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-quobyte-f6e698a2-a976-4457-86f8-444c2f66681d" released by "delete_volume" :: held 1.330s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Created reservations ['baab90e4-f329-4876-8215-2b94f6e5b4e3', 'f206e029-3a78-4348-b866-996e14e3d4d3', '0f5a4bcf-1e4d-4339-8534-33d468f05f4d', '13033e46-c614-4b19-bab9-ff5f9be00b91'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:23 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a 1G" returned: 0 in 1.065s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:23 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a Nov 02 10:56:23 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:24 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:24 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:24 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a is being set with open permissions: ugo+rw Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:24 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a Nov 02 10:56:24 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Deleted volume successfully. Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c4b096d6-1d8e-4157-a97c-d2ea42741f38 tempest-VolumesSnapshotTestJSON-1627136301 None] Lock "cinder-f6e698a2-a976-4457-86f8-444c2f66681d-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:24 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1905294060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8550c3e2-18d6-463b-a3db-cd5a830f7045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665cfba5862a4755b7834a16e7d8d14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:23Z,use_quota=True,user_id='c624c16d2cd44c75976d82af5c8c9f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Creating volume 8550c3e2-18d6-463b-a3db-cd5a830f7045 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:24 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 1073741824 Nov 02 10:56:24 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-76a14df0-94e8-43f6-9fa7-e65cdaf97053 tempest-VolumesSnapshotListTestJSON-1951018472 None] Create snapshot completed successfully Nov 02 10:56:25 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 1073741824" returned: 0 in 0.710s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:25 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 Nov 02 10:56:25 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:25 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b4d15a-386b-4869-99f4-397e907a0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8550c3e2-18d6-463b-a3db-cd5a830f7045', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4d7e1-4e87-48ff-bb8d-40a58343cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Volume volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 (8550c3e2-18d6-463b-a3db-cd5a830f7045): created successfully Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4d7e1-4e87-48ff-bb8d-40a58343cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Flow 'volume_create_manager' (09ee4baf-9647-43a1-8040-16f643996607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-daf45413-89d1-486d-acbc-4cbe169250b1 tempest-VolumesListAdminTestJSON-1496151374 None] Created volume successfully. Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-67fe5918-b9b7-4514-9728-67ae8a812c7a-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-67fe5918-b9b7-4514-9728-67ae8a812c7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-67fe5918-b9b7-4514-9728-67ae8a812c7a" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-67fe5918-b9b7-4514-9728-67ae8a812c7a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Deleting offline snapshot 67fe5918-b9b7-4514-9728-67ae8a812c7a of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] snapshot_file for this snap is: volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1069cf1e-8e84-40fc-844d-cf31cfea68af]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:26 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a Nov 02 10:56:26 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:26 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5c5bb-9295-4d91-b502-61ce476d1fd3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:27 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.598s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:27 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a Nov 02 10:56:27 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Flow 'volume_create_manager' (c5c2dea1-857c-48e0-9c12-57bd4b8cf673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6075f6-a4e2-4b5e-932c-19d411686c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6075f6-a4e2-4b5e-932c-19d411686c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c01f8-e48b-4553-806d-df931f36072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf575366a764784a1ff949c9e2b859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:28Z,use_quota=True,user_id='413ac706e48e498fa61501cf83396250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f96d2b-34d6-409f-8070-25c6faf22dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f96d2b-34d6-409f-8070-25c6faf22dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf695ff-af38-4dd0-a3e7-65b60172d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf695ff-af38-4dd0-a3e7-65b60172d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7c01f8-e48b-4553-806d-df931f36072e', 'volume_name': 'volume-cb7c01f8-e48b-4553-806d-df931f36072e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53fc419-be30-4a27-8548-1071e1e7f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53fc419-be30-4a27-8548-1071e1e7f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e785cd-c78f-4e0b-b285-0890f1b7b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Volume cb7c01f8-e48b-4553-806d-df931f36072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7c01f8-e48b-4553-806d-df931f36072e', 'volume_size': 1} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c01f8-e48b-4553-806d-df931f36072e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf575366a764784a1ff949c9e2b859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:28Z,use_quota=True,user_id='413ac706e48e498fa61501cf83396250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Creating volume cb7c01f8-e48b-4553-806d-df931f36072e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:27 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e 1073741824 Nov 02 10:56:27 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:28 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:28 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a Nov 02 10:56:28 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:28 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e 1073741824" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:28 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e Nov 02 10:56:28 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:28 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.67fe5918-b9b7-4514-9728-67ae8a812c7a" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-67fe5918-b9b7-4514-9728-67ae8a812c7a" released by "_delete_snapshot" :: held 1.983s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" released by "delete_snapshot" :: held 2.014s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Created reservations ['484ca797-e0ea-4016-82b4-28898a35b589', '0d1e943e-fdb7-4d99-892f-3cccc2231607', 'dfdd7b3f-54a0-48ef-bd07-82a9636fc2b3', '4a9875ed-30ff-4074-866e-eb90e3c043c3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Delete snapshot completed successfully. Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0dba4ec-bbc2-44bb-92ea-77d7a20e1e76 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-67fe5918-b9b7-4514-9728-67ae8a812c7a-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:28 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e" returned: 0 in 0.487s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e785cd-c78f-4e0b-b285-0890f1b7b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7c01f8-e48b-4553-806d-df931f36072e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e95a1d2-f239-4dd1-9cc1-a1f6c2bab593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Volume volume-cb7c01f8-e48b-4553-806d-df931f36072e (cb7c01f8-e48b-4553-806d-df931f36072e): created successfully Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e95a1d2-f239-4dd1-9cc1-a1f6c2bab593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Flow 'volume_create_manager' (c5c2dea1-857c-48e0-9c12-57bd4b8cf673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9cb2c6db-ac96-4ebc-a0ef-607745ea79a1 tempest-VolumesListAdminTestJSON-1765500790 None] Created volume successfully. Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Acquiring lock "cinder-cb7c01f8-e48b-4553-806d-df931f36072e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "cinder-cb7c01f8-e48b-4553-806d-df931f36072e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Deleting offline snapshot e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] snapshot_file for this snap is: volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4135eb5a-1007-46bf-be60-54956d4cf718]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Acquiring lock "cinder-quobyte-cb7c01f8-e48b-4553-806d-df931f36072e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-8550c3e2-18d6-463b-a3db-cd5a830f7045-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-8550c3e2-18d6-463b-a3db-cd5a830f7045-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "cinder-quobyte-cb7c01f8-e48b-4553-806d-df931f36072e" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e1d4a0-c71a-4bf9-83fb-4bd3f896a675]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-quobyte-8550c3e2-18d6-463b-a3db-cd5a830f7045" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-8550c3e2-18d6-463b-a3db-cd5a830f7045" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade1218-5899-41ec-adf8-c8bdebbe5c1d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:30 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e Nov 02 10:56:30 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 Nov 02 10:56:30 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.711s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c2351a-ce89-4560-91f8-7b06bb713d4e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:30 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e" returned: 0 in 0.635s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045" returned: 0 in 0.551s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:30 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e Nov 02 10:56:30 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045 Nov 02 10:56:30 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:30 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:30 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:31 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8550c3e2-18d6-463b-a3db-cd5a830f7045" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-8550c3e2-18d6-463b-a3db-cd5a830f7045" released by "delete_volume" :: held 1.003s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:31 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cb7c01f8-e48b-4553-806d-df931f36072e" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Created reservations ['a338ef23-3546-4803-aaa8-f517f29eef6b', '23d4b0f7-a696-499a-b52d-79941270bdb1', '4a15206f-85e8-419b-87d4-af4571bda11e', 'fb67840b-2061-4f44-b383-887f2450aaec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "cinder-quobyte-cb7c01f8-e48b-4553-806d-df931f36072e" released by "delete_volume" :: held 1.257s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:31 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.678s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:31 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:31 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Created reservations ['92299ff7-913e-469d-b2cb-2321d100d1de', '126ecdfa-a2f1-4798-8ca9-c219c001be03', '2a2eda7d-3661-41a2-b0fb-5539d566c1a7', 'f243de48-2ff6-4ab0-8e1d-2740870298d7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:31 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:31 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:31 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:31 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:31 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Deleted volume successfully. Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dc3e74a3-ed6d-4a24-9213-ef407d6cea5d tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-8550c3e2-18d6-463b-a3db-cd5a830f7045-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:31 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Deleted volume successfully. Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15666722-f4e9-4abb-8d0e-0ed0dedda60e tempest-VolumesListAdminTestJSON-1765500790 None] Lock "cinder-cb7c01f8-e48b-4553-806d-df931f36072e-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:31 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.644s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:32 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e Nov 02 10:56:32 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:32 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e" released by "_delete_snapshot" :: held 2.477s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" released by "delete_snapshot" :: held 2.528s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Created reservations ['060303aa-c688-4e39-afff-66c21996ad25', '32eee4cb-2259-44f6-81aa-dfd8f9ae95d5', 'ef16e54a-ca86-4991-afe7-906affa0d0a2', '77956d69-7b5e-46f8-9477-7e9acd11ee64'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-47ad2735-9091-4bdc-803f-98cc2a36b23e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-47ad2735-9091-4bdc-803f-98cc2a36b23e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-quobyte-47ad2735-9091-4bdc-803f-98cc2a36b23e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Delete snapshot completed successfully. Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7b6dea47-ca14-4b39-a150-b6e629bbe47e tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-e1f212d0-9a20-44ac-ae02-30bd7ffe7e4e-delete_snapshot" released by "delete_snapshot" :: held 2.830s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-47ad2735-9091-4bdc-803f-98cc2a36b23e" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d685a-2360-40c0-af7e-45f0a51efca5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:32 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e Nov 02 10:56:32 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e Nov 02 10:56:33 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-7d9e79d7-442b-4844-b182-8b237c31fea1-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-7d9e79d7-442b-4844-b182-8b237c31fea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-7d9e79d7-442b-4844-b182-8b237c31fea1" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-7d9e79d7-442b-4844-b182-8b237c31fea1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Deleting offline snapshot 7d9e79d7-442b-4844-b182-8b237c31fea1 of volume 5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] snapshot_file for this snap is: volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a17a7-cbb5-42ab-8ef8-05c00839dd12]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:33 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-47ad2735-9091-4bdc-803f-98cc2a36b23e" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-47ad2735-9091-4bdc-803f-98cc2a36b23e" released by "delete_volume" :: held 0.835s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Created reservations ['44af2c9c-0313-47ba-a041-953d005281b0', 'be54f9e7-6ae8-4286-bd02-c69f938e76b2', '5bffcd55-b07f-4399-9a2e-a37aeedc82d1', '96a76b7d-f99d-4614-aeee-05093cb9eb07'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:33 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:33 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.664s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158c5e4-ff75-4bf5-b1fc-30e306223f93]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "cinder-quobyte-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:34 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Deleted volume successfully. Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1370b-e5dc-4c1f-b9c3-5f94389bad12]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:34 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e Nov 02 10:56:34 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfee04e1-5339-417c-8a1d-21a5d8f775e7 tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-47ad2735-9091-4bdc-803f-98cc2a36b23e-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:34 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a Nov 02 10:56:34 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:34 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:34 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" returned: 0 in 0.630s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:34 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a Nov 02 10:56:34 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:34 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:34 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1 Nov 02 10:56:34 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-quobyte-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a" released by "delete_volume" :: held 1.028s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Created reservations ['30fa240b-484c-4a6e-b719-450afceb6321', '6b04f1bd-f3ca-483a-8225-3d146045b3dd', 'ae02d769-2db2-4470-a3cc-4e2f27d91bcd', '75439885-67fb-49d7-8b93-060a3f579cde'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:35 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e.7d9e79d7-442b-4844-b182-8b237c31fea1" returned: 0 in 0.332s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-7d9e79d7-442b-4844-b182-8b237c31fea1" released by "_delete_snapshot" :: held 2.033s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" released by "delete_snapshot" :: held 2.063s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:35 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:35 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Created reservations ['6c136f4c-8faf-4371-a5b8-72a096c3efc7', '7de91a85-4052-42c4-bfbb-493c6b0e4947', 'cfb38c3d-9956-4de1-9d57-a2a11983f3c5', '9ce5335e-89f0-42f1-88d5-cf727f2d2bd4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Delete snapshot completed successfully. Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdf031cd-a151-4f71-993a-6c8e4c283e62 tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-7d9e79d7-442b-4844-b182-8b237c31fea1-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:35 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Deleted volume successfully. Nov 02 10:56:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-114103ae-aded-47fe-8e0e-377b190b9a5e tempest-VolumesListAdminTestJSON-1496151374 None] Lock "cinder-a4c466e8-9be5-4d9f-af8d-8d135cea7a8a-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-5c24959e-a1d9-4064-947c-6dd020b6ef5e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-5c24959e-a1d9-4064-947c-6dd020b6ef5e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e018d23-9b58-4991-96f2-180abe548caa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:36 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e Nov 02 10:56:36 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:37 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e Nov 02 10:56:37 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c24959e-a1d9-4064-947c-6dd020b6ef5e" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-quobyte-5c24959e-a1d9-4064-947c-6dd020b6ef5e" released by "delete_volume" :: held 0.781s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Created reservations ['42a674e8-1df6-41b7-b833-5e54794f8e4a', 'c66ad5b1-c9c3-4f6b-8cba-423d8c627664', '0daa46bc-d4af-48d3-b133-199c9c8c40ae', '9d14666d-e3ea-467d-b36d-1fcd5f966100'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:37 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:37 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:37 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Deleted volume successfully. Nov 02 10:56:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06fad8e1-480c-4249-b28c-8bde126d7cbb tempest-VolumesSnapshotListTestJSON-1951018472 None] Lock "cinder-5c24959e-a1d9-4064-947c-6dd020b6ef5e-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Flow 'volume_create_manager' (1077754a-05dc-4e02-8827-7c2e4e749d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d7d065-1dc5-4659-818d-692b46e471f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d7d065-1dc5-4659-818d-692b46e471f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1292081304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bba4da-8971-4316-9a7f-9146eb1f830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f093654116a34aec830efbc73f4b37d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:43Z,use_quota=True,user_id='95d138adb9184b679944b6314dc12139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b842f422-f40c-49b5-afb6-7f1243162c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b842f422-f40c-49b5-afb6-7f1243162c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcec287-3166-4af0-bc5c-fec4d2d20524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcec287-3166-4af0-bc5c-fec4d2d20524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bba4da-8971-4316-9a7f-9146eb1f830f', 'volume_name': 'volume-a6bba4da-8971-4316-9a7f-9146eb1f830f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b88e39-fd31-4ad2-a37f-a32bc7c698f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b88e39-fd31-4ad2-a37f-a32bc7c698f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a517d28-30f5-4355-96ba-978f4fd4e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Volume a6bba4da-8971-4316-9a7f-9146eb1f830f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bba4da-8971-4316-9a7f-9146eb1f830f', 'volume_size': 1} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1292081304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bba4da-8971-4316-9a7f-9146eb1f830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f093654116a34aec830efbc73f4b37d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:43Z,use_quota=True,user_id='95d138adb9184b679944b6314dc12139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Creating volume a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:43 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f 1073741824 Nov 02 10:56:43 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:43 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f 1073741824" returned: 0 in 0.563s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:43 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f Nov 02 10:56:43 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:43 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a517d28-30f5-4355-96ba-978f4fd4e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bba4da-8971-4316-9a7f-9146eb1f830f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d781db9e-5f8f-43a2-9601-9bd57ff8357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Volume volume-a6bba4da-8971-4316-9a7f-9146eb1f830f (a6bba4da-8971-4316-9a7f-9146eb1f830f): created successfully Nov 02 10:56:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d781db9e-5f8f-43a2-9601-9bd57ff8357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Flow 'volume_create_manager' (1077754a-05dc-4e02-8827-7c2e4e749d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7d5f7e01-4fdb-4a3d-bfd9-d91fe50c13db tempest-SnapshotMetadataTestJSON-1706948308 None] Created volume successfully. Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Creating offline snapshot 2380ed43-7c36-4a48-ad7f-482c858c19d0 of volume a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56eae99-e02c-43eb-8c10-cc089840602f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:45 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f Nov 02 10:56:45 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:45 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:45 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 1G Nov 02 10:56:45 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:46 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 1G" returned: 0 in 0.665s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bba4da-8971-4316-9a7f-9146eb1f830f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:46 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bba4da-8971-4316-9a7f-9146eb1f830f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 Nov 02 10:56:46 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:46 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bba4da-8971-4316-9a7f-9146eb1f830f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:46 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 is being set with open permissions: ugo+rw Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:46 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 Nov 02 10:56:46 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Flow 'volume_create_manager' (2f5afaf2-b05e-415f-8ca4-aa26daf3a0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980fe5a9-76d6-4ee6-8b92-09f1d32ddab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980fe5a9-76d6-4ee6-8b92-09f1d32ddab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-885998303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39690a-a12f-4f76-a965-2aa39b979008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f9f4c8d904ceeaa37046a3714f3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:47Z,use_quota=True,user_id='ce1b550dfc054691a236e6ee3f10d098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6386ff-d1fa-4b5e-b996-66aa42f3ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6386ff-d1fa-4b5e-b996-66aa42f3ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50369b6-6abd-4465-95b6-d50273ef146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50369b6-6abd-4465-95b6-d50273ef146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d39690a-a12f-4f76-a965-2aa39b979008', 'volume_name': 'volume-1d39690a-a12f-4f76-a965-2aa39b979008', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af5cb7b-e8c7-4724-8318-c05a851ccffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af5cb7b-e8c7-4724-8318-c05a851ccffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c61fabe-e947-4215-a589-4ae9ceabcbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Volume 1d39690a-a12f-4f76-a965-2aa39b979008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d39690a-a12f-4f76-a965-2aa39b979008', 'volume_size': 1} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:47 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:47 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info Nov 02 10:56:47 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:47 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info" returned: 0 in 0.300s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:47 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info is being set with open permissions: ugo+rw Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:47 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info Nov 02 10:56:47 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:47 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.info" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-885998303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d39690a-a12f-4f76-a965-2aa39b979008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f9f4c8d904ceeaa37046a3714f3e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:56:47Z,use_quota=True,user_id='ce1b550dfc054691a236e6ee3f10d098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Creating volume 1d39690a-a12f-4f76-a965-2aa39b979008 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:56:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:47 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 1073741824 Nov 02 10:56:47 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5c7a2528-133e-4f20-af49-6f67b4681372 tempest-SnapshotMetadataTestJSON-1706948308 None] Create snapshot completed successfully Nov 02 10:56:48 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 1073741824" returned: 0 in 0.631s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:48 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 Nov 02 10:56:48 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:48 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c61fabe-e947-4215-a589-4ae9ceabcbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d39690a-a12f-4f76-a965-2aa39b979008', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a51f4f7-c15c-4b72-8f86-9083b30bea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:56:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Volume volume-1d39690a-a12f-4f76-a965-2aa39b979008 (1d39690a-a12f-4f76-a965-2aa39b979008): created successfully Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a51f4f7-c15c-4b72-8f86-9083b30bea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Flow 'volume_create_manager' (2f5afaf2-b05e-415f-8ca4-aa26daf3a0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:56:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8f48a557-867b-47b4-aa68-bdf993e00ef4 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Created volume successfully. Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "cinder-2380ed43-7c36-4a48-ad7f-482c858c19d0-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-2380ed43-7c36-4a48-ad7f-482c858c19d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "cinder-quobyte-2380ed43-7c36-4a48-ad7f-482c858c19d0" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-2380ed43-7c36-4a48-ad7f-482c858c19d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Deleting offline snapshot 2380ed43-7c36-4a48-ad7f-482c858c19d0 of volume a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] snapshot_file for this snap is: volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669280f-4020-4355-8811-afee375a56f9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:49 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 Nov 02 10:56:49 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:50 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6bba4da-8971-4316-9a7f-9146eb1f830f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffa28ee-34cf-47b8-8ca8-14076d8d1b4e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:50 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f Nov 02 10:56:50 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:50 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f" returned: 0 in 0.582s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:51 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 Nov 02 10:56:51 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=163,cinder:DELETE=9,cinder:SELECT=125,cinder:INSERT=39 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=123,cinder:INSERT=43,cinder:UPDATE=161,cinder:DELETE=19 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-80021b85-0fed-478a-8fad-c692e54058f5 req-282b0115-b826-4bde-a0c2-888ec2fddb63 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-80021b85-0fed-478a-8fad-c692e54058f5 req-282b0115-b826-4bde-a0c2-888ec2fddb63 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-80021b85-0fed-478a-8fad-c692e54058f5 req-282b0115-b826-4bde-a0c2-888ec2fddb63 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-80021b85-0fed-478a-8fad-c692e54058f5 req-282b0115-b826-4bde-a0c2-888ec2fddb63 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-1d39690a-a12f-4f76-a965-2aa39b979008', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ba2208c-8b92-46d0-a884-7865402b4ac7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:56:51 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-80021b85-0fed-478a-8fad-c692e54058f5 req-282b0115-b826-4bde-a0c2-888ec2fddb63 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] attachment_update completed successfully. Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0" returned: 0 in 0.530s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:51 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0 Nov 02 10:56:51 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:51 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f.2380ed43-7c36-4a48-ad7f-482c858c19d0" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-2380ed43-7c36-4a48-ad7f-482c858c19d0" released by "_delete_snapshot" :: held 2.210s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" released by "delete_snapshot" :: held 2.246s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:52 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Created reservations ['c7176a0a-3ed0-4e15-8cf2-b67a1c36bf36', '4eb0dcfd-f4bd-4179-a683-6f15ad003d6e', '237e6b04-cc54-429d-9e0a-916ac433db81', '8566c290-11ee-4056-bf54-a1b4e3ea1d7b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Delete snapshot completed successfully. Nov 02 10:56:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7c2777f4-d10b-4d76-b8a4-fd50d6235de1 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-2380ed43-7c36-4a48-ad7f-482c858c19d0-delete_snapshot" released by "delete_snapshot" :: held 2.504s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "cinder-a6bba4da-8971-4316-9a7f-9146eb1f830f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-a6bba4da-8971-4316-9a7f-9146eb1f830f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[82607ebb-a2dc-4f29-b24c-16f237c34a9b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:53 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f Nov 02 10:56:53 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:53 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f" returned: 0 in 0.672s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:53 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f Nov 02 10:56:53 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:54 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a6bba4da-8971-4316-9a7f-9146eb1f830f" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-quobyte-a6bba4da-8971-4316-9a7f-9146eb1f830f" released by "delete_volume" :: held 1.138s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Created reservations ['87a29e44-9a03-40a5-aace-554486a5ad64', '8096583a-d6f6-4f63-8cf5-8c5dd10005bf', '6b874139-6288-4060-9a92-2edb5ede651a', '7746417d-5e62-4388-a104-698f87042fa4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:54 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:54 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:54 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Deleted volume successfully. Nov 02 10:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b6330caa-8776-40a9-8f16-a62cdb92dc86 tempest-SnapshotMetadataTestJSON-1706948308 None] Lock "cinder-a6bba4da-8971-4316-9a7f-9146eb1f830f-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-6442e349-3126-418e-8659-aa676eb81965 req-0edd639c-cbad-4043-835b-1e38f72147a0 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Terminate volume connection completed successfully. Nov 02 10:56:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-6442e349-3126-418e-8659-aa676eb81965 req-0edd639c-cbad-4043-835b-1e38f72147a0 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Deleting attachment 8ba2208c-8b92-46d0-a884-7865402b4ac7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "cinder-1d39690a-a12f-4f76-a965-2aa39b979008-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "cinder-1d39690a-a12f-4f76-a965-2aa39b979008-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "cinder-quobyte-1d39690a-a12f-4f76-a965-2aa39b979008" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "cinder-quobyte-1d39690a-a12f-4f76-a965-2aa39b979008" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[11300df7-3d9b-4a7b-82a4-3f04b615842f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:56 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 Nov 02 10:56:56 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:57 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:57 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008 Nov 02 10:56:57 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:57 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1d39690a-a12f-4f76-a965-2aa39b979008" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "cinder-quobyte-1d39690a-a12f-4f76-a965-2aa39b979008" released by "delete_volume" :: held 0.855s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Created reservations ['cec2fb25-7f35-49a1-bac2-db9a83717cea', '752bea57-330c-45a0-9105-6114fa91cb1a', '7a77e340-2fae-4888-8b50-eaeedc4d6cd6', '058be245-6d7b-426d-9c7b-893d1f714b10'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:56:57 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:56:57 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:56:58 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 02 10:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:56:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:56:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Deleted volume successfully. Nov 02 10:56:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b4e72f5a-8a1e-4674-97d9-27c1886b3766 tempest-TestServerVolumeAttachScenarioOldVersion-841432741 None] Lock "cinder-1d39690a-a12f-4f76-a965-2aa39b979008-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:02 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Flow 'volume_create_manager' (5755d69a-49ea-4cc1-88f6-bf67740f0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1df428-781a-4750-a3e1-2acf1038393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1df428-781a-4750-a3e1-2acf1038393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129089348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2ddbd4-3b37-483d-8e8a-e43056376ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef6237db6bf4c68aa729b3e152ae727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:03Z,use_quota=True,user_id='cad7757f15f640c197438f36ca3517be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2a1ef-be4f-47d7-bec0-30e398cf95ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2a1ef-be4f-47d7-bec0-30e398cf95ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e622c-d002-4193-b632-60ec596abc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e622c-d002-4193-b632-60ec596abc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b2ddbd4-3b37-483d-8e8a-e43056376ab2', 'volume_name': 'volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3be43f-d4aa-4f2f-acdc-87696e651249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3be43f-d4aa-4f2f-acdc-87696e651249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38dde26-f9f8-4f56-91c4-344cc968f10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Trying to clone 9b2ddbd4-3b37-483d-8e8a-e43056376ab2 from image 134ee211-162c-468b-b66a-c0628be004d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:57:03 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Image download 20.69 MB at 20.69 MB/s Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83dff5f-b3ea-4fcc-bb16-e061cd936f23]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:04 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD Nov 02 10:57:04 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:04 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 is fetched for user cad7757f15f640c197438f36ca3517be. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ec46a-c6cd-45ab-b9c7-0f6e549432d1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:04 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD Nov 02 10:57:04 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:04 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129089348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2ddbd4-3b37-483d-8e8a-e43056376ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef6237db6bf4c68aa729b3e152ae727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:03Z,use_quota=True,user_id='cad7757f15f640c197438f36ca3517be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Creating volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:04 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1073741824 Nov 02 10:57:04 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:05 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1073741824" returned: 0 in 0.592s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:05 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 Nov 02 10:57:05 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:05 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Attempting download of 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e974cf-b389-4e39-9558-8512ad1a8f5e]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:06 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j Nov 02 10:57:06 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:06 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:06 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j Nov 02 10:57:06 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:06 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j" returned: 1 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_tuwpqk9j' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cadf68e-604e-4921-9370-002a20c54e8a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:06 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD Nov 02 10:57:06 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:07 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:07 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] 134ee211-162c-468b-b66a-c0628be004d6 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:07 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 Nov 02 10:57:07 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:09 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:57:09 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:09 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" returned: 0 in 2.698s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_lqqnzl6vdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:57:09 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Converted 112.00 MB image at 41.45 MB/s Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:09 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:09 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1G Nov 02 10:57:09 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:57:10 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 1G" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Downloaded image 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 for user cad7757f15f640c197438f36ca3517be is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Marking volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Copying metadata from image 134ee211-162c-468b-b66a-c0628be004d6 to 9b2ddbd4-3b37-483d-8e8a-e43056376ab2. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Creating volume glance metadata for volume 9b2ddbd4-3b37-483d-8e8a-e43056376ab2 backed by image 134ee211-162c-468b-b66a-c0628be004d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38dde26-f9f8-4f56-91c4-344cc968f10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b076a3e0-9bee-4b10-ad17-5f1aa333f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Volume volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 (9b2ddbd4-3b37-483d-8e8a-e43056376ab2): created successfully Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b076a3e0-9bee-4b10-ad17-5f1aa333f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Flow 'volume_create_manager' (5755d69a-49ea-4cc1-88f6-bf67740f0f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0c7d3f62-fe02-45bf-bb6b-a3ace4f5b2d4 tempest-VolumesExtendTest-551947054 None] Created volume successfully. Nov 02 10:57:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89747b-e390-4435-bb86-e1718fdaff9e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:11 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 Nov 02 10:57:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:12 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" returned: 0 in 0.623s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 2G" returned: 0 in 0.201s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.863s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7feb9096-f90e-4331-8152-91adb1534948 tempest-VolumesExtendTest-551947054 None] Extend volume completed successfully. Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-9b2ddbd4-3b37-483d-8e8a-e43056376ab2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "cinder-9b2ddbd4-3b37-483d-8e8a-e43056376ab2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Flow 'volume_create_manager' (a316c1f0-4b75-4bbb-823a-9ea466dfb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e703855-38da-454a-b4cd-9244b4721f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e703855-38da-454a-b4cd-9244b4721f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2103880033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fbb268-d57b-46d3-9e91-c3f867590c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66dc8da09bb43bab49ce67af95bf039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:13Z,use_quota=True,user_id='1dfc8fa9adf1493b9c40fe4e40d568ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6988c8-4eae-4949-b7f5-6b3993356d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6988c8-4eae-4949-b7f5-6b3993356d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa3ae6-0c73-4c7a-9981-94b2f8127555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa3ae6-0c73-4c7a-9981-94b2f8127555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12fbb268-d57b-46d3-9e91-c3f867590c01', 'volume_name': 'volume-12fbb268-d57b-46d3-9e91-c3f867590c01', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4fc60a-05a0-4af8-80bc-795eb34acce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4fc60a-05a0-4af8-80bc-795eb34acce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88571707-fb1a-4ed0-9b30-a530d5cbcd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:13 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Volume 12fbb268-d57b-46d3-9e91-c3f867590c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12fbb268-d57b-46d3-9e91-c3f867590c01', 'volume_size': 1} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2103880033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fbb268-d57b-46d3-9e91-c3f867590c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66dc8da09bb43bab49ce67af95bf039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:13Z,use_quota=True,user_id='1dfc8fa9adf1493b9c40fe4e40d568ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Creating volume 12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:13 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-quobyte-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:13 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 1073741824 Nov 02 10:57:13 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666070e-6ae7-4d1d-a52c-c589b3828829]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:13 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 Nov 02 10:57:13 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (b60fbe25-1a88-407e-8d38-82ffccd34479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1731e76a-14b3-445f-be3f-02b62f9da5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:14 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1731e76a-14b3-445f-be3f-02b62f9da5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-646837381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a02f2c5-3134-4dba-a946-ee53c6ebb16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:14Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2739f410-e49e-47fe-9832-c31eb57289ff),volume_type_id=2739f410-e49e-47fe-9832-c31eb57289ff)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b7c7b-e0e7-442e-969f-ce7944128cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b7c7b-e0e7-442e-969f-ce7944128cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12d798b-48f9-44f7-8f74-49776c653793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:14 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12d798b-48f9-44f7-8f74-49776c653793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a02f2c5-3134-4dba-a946-ee53c6ebb16e', 'volume_name': 'volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893fc060-aac2-4297-a7f2-496b7144b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893fc060-aac2-4297-a7f2-496b7144b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e8179-2c9c-4669-a615-61f9d8a3cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume 4a02f2c5-3134-4dba-a946-ee53c6ebb16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e', 'volume_size': 1} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 1073741824" returned: 0 in 0.923s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" returned: 0 in 0.798s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:14 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2 Nov 02 10:57:14 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:14 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:57:14 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (570f0520-f130-4761-91dd-59bbd0cb5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c349165a-3023-46d8-b9e6-55709925445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c349165a-3023-46d8-b9e6-55709925445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-882232925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097afa02-3e2b-448e-8167-48b6fa61edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:15Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf75de81-b741-478f-9ca0-87165ab307f8),volume_type_id=bf75de81-b741-478f-9ca0-87165ab307f8)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24730560-a85f-4031-8cb6-465937b5aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24730560-a85f-4031-8cb6-465937b5aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f18d8c6-e558-4c7e-963f-e4127a8f1efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f18d8c6-e558-4c7e-963f-e4127a8f1efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097afa02-3e2b-448e-8167-48b6fa61edad', 'volume_name': 'volume-097afa02-3e2b-448e-8167-48b6fa61edad', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad137fb9-4290-495e-8a97-a27b620dd635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad137fb9-4290-495e-8a97-a27b620dd635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995b13b-920b-4cf4-adcc-c3b47e366ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume 097afa02-3e2b-448e-8167-48b6fa61edad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097afa02-3e2b-448e-8167-48b6fa61edad', 'volume_size': 1} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" returned: 0 in 0.634s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-9b2ddbd4-3b37-483d-8e8a-e43056376ab2" released by "delete_volume" :: held 1.528s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:15 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.603s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-646837381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a02f2c5-3134-4dba-a946-ee53c6ebb16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:14Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2739f410-e49e-47fe-9832-c31eb57289ff),volume_type_id=2739f410-e49e-47fe-9832-c31eb57289ff)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Creating volume 4a02f2c5-3134-4dba-a946-ee53c6ebb16e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:15 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Created reservations ['316efae4-d577-4368-89c0-ffa1a28d67f4', 'c14cdc1d-8ccb-47e1-bbb5-039fac628a94', '98c874c6-e9ca-4d0b-a9a9-d25000d7c3f8', '0c7a5ab7-0139-481d-a186-57cfb8f7cddb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88571707-fb1a-4ed0-9b30-a530d5cbcd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12fbb268-d57b-46d3-9e91-c3f867590c01', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c7a0e-bb79-4a5d-8a10-3f0d8fdec422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:15 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e 1073741824 Nov 02 10:57:15 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Volume volume-12fbb268-d57b-46d3-9e91-c3f867590c01 (12fbb268-d57b-46d3-9e91-c3f867590c01): created successfully Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c7a0e-bb79-4a5d-8a10-3f0d8fdec422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Flow 'volume_create_manager' (a316c1f0-4b75-4bbb-823a-9ea466dfb979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-83697bb0-8a5e-4007-a8c8-29e3d5ec22d9 tempest-TestStampPattern-1862550995 None] Created volume successfully. Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:15 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:57:15 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (a989108c-08ee-4122-bc0e-a0b65dbafbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209362db-ed87-48ba-8367-6ca164333af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209362db-ed87-48ba-8367-6ca164333af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-677832333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71a32d8-e27e-4982-962d-db7b7c944f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:16Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4abd9003-5d0f-4dc9-bb03-1e832538310c),volume_type_id=4abd9003-5d0f-4dc9-bb03-1e832538310c)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc4a4a6-3250-45e8-8801-bd1cc40c5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc4a4a6-3250-45e8-8801-bd1cc40c5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6934e439-5801-4d71-aa08-7ad4099ffd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.635s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Deleted volume successfully. Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-713772ec-2098-45f0-a416-60dd604c0bda tempest-VolumesExtendTest-551947054 None] Lock "cinder-9b2ddbd4-3b37-483d-8e8a-e43056376ab2-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:16 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e 1073741824" returned: 0 in 0.987s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:16 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e Nov 02 10:57:16 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6934e439-5801-4d71-aa08-7ad4099ffd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b71a32d8-e27e-4982-962d-db7b7c944f52', 'volume_name': 'volume-b71a32d8-e27e-4982-962d-db7b7c944f52', 'volume_size': 1, 'image_id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1589136856', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '178b0579c3864dba949cd7de52fa4396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'created_at': datetime.datetime(2026, 11, 2, 9, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 57, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4228a830-a29f-4a04-b45f-8e5990992d3c/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4f7602-871b-4e07-a109-91022899608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4f7602-871b-4e07-a109-91022899608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7d12b0-9bbd-4c0c-8d7d-c4c42407dada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume b71a32d8-e27e-4982-962d-db7b7c944f52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b71a32d8-e27e-4982-962d-db7b7c944f52', 'volume_size': 1, 'image_id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1589136856', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '178b0579c3864dba949cd7de52fa4396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'created_at': datetime.datetime(2026, 11, 2, 9, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 57, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4228a830-a29f-4a04-b45f-8e5990992d3c/file', 'properties': {}}, 'image_service': } Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Trying to clone b71a32d8-e27e-4982-962d-db7b7c944f52 from image 4228a830-a29f-4a04-b45f-8e5990992d3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:57:16 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-882232925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097afa02-3e2b-448e-8167-48b6fa61edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:15Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf75de81-b741-478f-9ca0-87165ab307f8),volume_type_id=bf75de81-b741-478f-9ca0-87165ab307f8)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Creating volume 097afa02-3e2b-448e-8167-48b6fa61edad {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:16 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad 1073741824 Nov 02 10:57:16 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e8179-2c9c-4669-a615-61f9d8a3cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f2e1f-4dae-45bc-aac1-968ec611879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e (4a02f2c5-3134-4dba-a946-ee53c6ebb16e): created successfully Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f2e1f-4dae-45bc-aac1-968ec611879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (b60fbe25-1a88-407e-8d38-82ffccd34479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Flow 'volume_create_manager' (4fe89377-8adc-4562-a615-fe1c5e08e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a79a4d5-baa6-46e5-a181-061cf10ead23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b4229c50-f947-4a66-b48a-0babae87f2bd tempest-TestInstancesWithCinderVolumes-1368920707 None] Created volume successfully. Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a79a4d5-baa6-46e5-a181-061cf10ead23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-647481958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df597439-542f-432f-ae9a-260a82b8279e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef6237db6bf4c68aa729b3e152ae727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:17Z,use_quota=True,user_id='cad7757f15f640c197438f36ca3517be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77329ad6-f9bf-4f18-a41e-b6847d230917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77329ad6-f9bf-4f18-a41e-b6847d230917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c907f-aa00-4f31-aadd-b2e3204a671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c907f-aa00-4f31-aadd-b2e3204a671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df597439-542f-432f-ae9a-260a82b8279e', 'volume_name': 'volume-df597439-542f-432f-ae9a-260a82b8279e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0064a8e0-18e3-4643-abdb-b9da698e7398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0064a8e0-18e3-4643-abdb-b9da698e7398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a013d76-b419-4286-ac93-fba5065584f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Volume df597439-542f-432f-ae9a-260a82b8279e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df597439-542f-432f-ae9a-260a82b8279e', 'volume_size': 1} Nov 02 10:57:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:17 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad 1073741824" returned: 0 in 0.929s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:17 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad Nov 02 10:57:17 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:18 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-647481958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df597439-542f-432f-ae9a-260a82b8279e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef6237db6bf4c68aa729b3e152ae727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:17Z,use_quota=True,user_id='cad7757f15f640c197438f36ca3517be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Creating volume df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:18 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:18 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e 1073741824 Nov 02 10:57:18 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0995b13b-920b-4cf4-adcc-c3b47e366ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097afa02-3e2b-448e-8167-48b6fa61edad', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5553a7e4-5f41-43af-88f7-c002781e153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume volume-097afa02-3e2b-448e-8167-48b6fa61edad (097afa02-3e2b-448e-8167-48b6fa61edad): created successfully Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5553a7e4-5f41-43af-88f7-c002781e153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (570f0520-f130-4761-91dd-59bbd0cb5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-53f81925-519e-4dd7-ab2f-f9a9f930fc3b tempest-TestInstancesWithCinderVolumes-1368920707 None] Created volume successfully. Nov 02 10:57:18 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e 1073741824" returned: 0 in 0.659s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:19 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:19 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:19 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a013d76-b419-4286-ac93-fba5065584f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df597439-542f-432f-ae9a-260a82b8279e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35daa89d-373b-4b16-ad0e-d42af1dd8568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Volume volume-df597439-542f-432f-ae9a-260a82b8279e (df597439-542f-432f-ae9a-260a82b8279e): created successfully Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35daa89d-373b-4b16-ad0e-d42af1dd8568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Flow 'volume_create_manager' (4fe89377-8adc-4562-a615-fe1c5e08e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-649f88cc-8dfc-4aa5-8d8f-7267cd56c6d9 tempest-VolumesExtendTest-551947054 None] Created volume successfully. Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Creating offline snapshot 7a9c788d-a096-40c1-935a-b2bfedafaf83 of volume df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79b1e4-8976-48ff-8053-4c82646b4801]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:20 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:20 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:20 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:20 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 1G Nov 02 10:57:20 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:22 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 1G" returned: 0 in 1.185s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df597439-542f-432f-ae9a-260a82b8279e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:22 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df597439-542f-432f-ae9a-260a82b8279e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 Nov 02 10:57:22 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:22 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df597439-542f-432f-ae9a-260a82b8279e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83" returned: 0 in 0.557s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:22 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 is being set with open permissions: ugo+rw Nov 02 10:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:22 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 Nov 02 10:57:22 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:23 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:23 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info Nov 02 10:57:23 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD, size 20.69 MB, duration 6.60 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:57:23 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Image download 20.69 MB at 3.13 MB/s Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9202a4d-27ab-4a14-8b0d-d483e920bbc2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:23 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD Nov 02 10:57:23 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:23 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info" returned: 0 in 0.587s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:23 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info is being set with open permissions: ugo+rw Nov 02 10:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:23 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info Nov 02 10:57:23 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:23 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD" returned: 0 in 0.550s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Temporary image 4228a830-a29f-4a04-b45f-8e5990992d3c is fetched for user 1be99d95cd4b4171bac4375683685388. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ef85a-8b0c-4d62-830b-02a7b707b3f7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:24 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.info" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.908s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-72fb033d-0b37-4555-839b-b4e6944aad1f tempest-VolumesExtendTest-551947054 None] Create snapshot completed successfully Nov 02 10:57:24 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD Nov 02 10:57:24 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:24 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-677832333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71a32d8-e27e-4982-962d-db7b7c944f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b0579c3864dba949cd7de52fa4396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:57:16Z,use_quota=True,user_id='1be99d95cd4b4171bac4375683685388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4abd9003-5d0f-4dc9-bb03-1e832538310c),volume_type_id=4abd9003-5d0f-4dc9-bb03-1e832538310c)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Creating volume b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:57:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:24 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1073741824 Nov 02 10:57:24 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:25 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1073741824" returned: 0 in 0.660s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:25 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 Nov 02 10:57:25 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:25 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.740s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e22064-d474-435b-9196-5e1afa844abf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Attempting download of 4228a830-a29f-4a04-b45f-8e5990992d3c ((None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}])) to volume b71a32d8-e27e-4982-962d-db7b7c944f52. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe1e09c-913f-4417-8f3f-a5a04ce5a2ab]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:25 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:25 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:26 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix Nov 02 10:57:26 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:26 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.765s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:26 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix" returned: 0 in 0.813s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 2G" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.197s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-567745cb-618d-4043-839b-c4dbeb443f21 tempest-VolumesExtendTest-551947054 None] Extend volume completed successfully. Nov 02 10:57:27 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix Nov 02 10:57:27 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:27 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix" returned: 1 in 0.704s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4228a830-a29f-4a04-b45f-8e5990992d3c_041r5fix' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080a6df-4242-4082-b9c6-502f74738ddf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-7a9c788d-a096-40c1-935a-b2bfedafaf83-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-7a9c788d-a096-40c1-935a-b2bfedafaf83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-quobyte-7a9c788d-a096-40c1-935a-b2bfedafaf83" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-7a9c788d-a096-40c1-935a-b2bfedafaf83" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Deleting offline snapshot 7a9c788d-a096-40c1-935a-b2bfedafaf83 of volume df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] snapshot_file for this snap is: volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ad3fdb-7cac-4bb4-9448-303b200427de]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:27 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD Nov 02 10:57:27 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:27 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 Nov 02 10:57:27 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:27 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] 4228a830-a29f-4a04-b45f-8e5990992d3c was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:57:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:27 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 Nov 02 10:57:27 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:28 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83" returned: 0 in 0.439s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df597439-542f-432f-ae9a-260a82b8279e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5ba9d-f007-48a0-a03d-188a71c7119f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:28 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:28 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:28 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.734s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:28 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 Nov 02 10:57:28 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:29 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:29 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83 Nov 02 10:57:29 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:30 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e.7a9c788d-a096-40c1-935a-b2bfedafaf83" returned: 0 in 0.510s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-7a9c788d-a096-40c1-935a-b2bfedafaf83" released by "_delete_snapshot" :: held 2.475s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" released by "delete_snapshot" :: held 2.515s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Created reservations ['f4b6be85-418a-426e-9c8e-73949e8f3c78', 'eeeed4d7-b40b-4a22-bd2a-5a6681be0125', 'edba824d-e25e-4d0e-b099-ae3ffe8bbf74', '984edd8a-7e84-4ab2-8107-eec94d5f7727'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Delete snapshot completed successfully. Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f2bb7f8c-b317-456b-9d55-041bdd5d3fa8 tempest-VolumesExtendTest-551947054 None] Lock "cinder-7a9c788d-a096-40c1-935a-b2bfedafaf83-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:30 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52" returned: 0 in 2.810s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4228a830-a29f-4a04-b45f-8e5990992d3c_3flzpa03devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:57:30 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Converted 112.00 MB image at 39.84 MB/s Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:30 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1G Nov 02 10:57:30 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-df597439-542f-432f-ae9a-260a82b8279e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "cinder-df597439-542f-432f-ae9a-260a82b8279e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Acquiring lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[269221cc-8b9a-444d-917c-a90f9d1238f1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:31 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 1G" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Downloaded image 4228a830-a29f-4a04-b45f-8e5990992d3c ((None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}])) to volume b71a32d8-e27e-4982-962d-db7b7c944f52 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Temporary image 4228a830-a29f-4a04-b45f-8e5990992d3c for user 1be99d95cd4b4171bac4375683685388 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Marking volume b71a32d8-e27e-4982-962d-db7b7c944f52 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Copying metadata from image 4228a830-a29f-4a04-b45f-8e5990992d3c to b71a32d8-e27e-4982-962d-db7b7c944f52. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Creating volume glance metadata for volume b71a32d8-e27e-4982-962d-db7b7c944f52 backed by image 4228a830-a29f-4a04-b45f-8e5990992d3c with: {'image_id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'image_name': 'tempest-scenario-img--1589136856', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:57:31 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:31 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7d12b0-9bbd-4c0c-8d7d-c4c42407dada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71a32d8-e27e-4982-962d-db7b7c944f52', 'volume_size': 1, 'image_id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4228a830-a29f-4a04-b45f-8e5990992d3c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1589136856', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '178b0579c3864dba949cd7de52fa4396', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4228a830-a29f-4a04-b45f-8e5990992d3c', 'created_at': datetime.datetime(2026, 11, 2, 9, 57, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 57, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4228a830-a29f-4a04-b45f-8e5990992d3c/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bdb3e2-fda0-4a69-a3ba-4c59c6faacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:57:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Volume volume-b71a32d8-e27e-4982-962d-db7b7c944f52 (b71a32d8-e27e-4982-962d-db7b7c944f52): created successfully Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bdb3e2-fda0-4a69-a3ba-4c59c6faacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Flow 'volume_create_manager' (a989108c-08ee-4122-bc0e-a0b65dbafbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:57:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc16b698-a528-4c8c-8a19-652a215cfd5c tempest-TestInstancesWithCinderVolumes-1368920707 None] Created volume successfully. Nov 02 10:57:31 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.548s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:31 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e Nov 02 10:57:31 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:31 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-df597439-542f-432f-ae9a-260a82b8279e" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "cinder-quobyte-df597439-542f-432f-ae9a-260a82b8279e" released by "delete_volume" :: held 0.960s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Created reservations ['a9e4e589-06c6-4491-9f0d-2afe005acf6f', 'f652b30d-15f3-4139-a218-c845be2f9668', 'd2f3d0f0-2223-48dd-9f5d-e296f1902582', '21077032-9d7a-469f-9c37-e1e728c65e83'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:32 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:57:32 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:32 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:57:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Deleted volume successfully. Nov 02 10:57:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d801a613-955f-43a8-ab18-98016741f2ce tempest-VolumesExtendTest-551947054 None] Lock "cinder-df597439-542f-432f-ae9a-260a82b8279e-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:57:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-1bde6e2b-2e25-485c-91b9-7cf08a8dea94 req-1e43d2f7-99c5-47f4-a81c-0bac046fc96a tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-1bde6e2b-2e25-485c-91b9-7cf08a8dea94 req-1e43d2f7-99c5-47f4-a81c-0bac046fc96a tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-1bde6e2b-2e25-485c-91b9-7cf08a8dea94 req-1e43d2f7-99c5-47f4-a81c-0bac046fc96a tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-1bde6e2b-2e25-485c-91b9-7cf08a8dea94 req-1e43d2f7-99c5-47f4-a81c-0bac046fc96a tempest-TestInstancesWithCinderVolumes-1368920707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-b71a32d8-e27e-4982-962d-db7b7c944f52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8d2e47e-ae4f-41e6-ad2a-c81d24b21eeb', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:57:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-1bde6e2b-2e25-485c-91b9-7cf08a8dea94 req-1e43d2f7-99c5-47f4-a81c-0bac046fc96a tempest-TestInstancesWithCinderVolumes-1368920707 None] attachment_update completed successfully. Nov 02 10:57:46 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=73,cinder:UPDATE=71,cinder:INSERT=28,cinder:DELETE=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:46 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=78,cinder:UPDATE=76,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-27732c65-8806-4683-9647-e872c39a6a66 req-f1c85066-e153-442e-9d36-dd0aec564719 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-27732c65-8806-4683-9647-e872c39a6a66 req-f1c85066-e153-442e-9d36-dd0aec564719 tempest-TestStampPattern-1862550995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-27732c65-8806-4683-9647-e872c39a6a66 req-f1c85066-e153-442e-9d36-dd0aec564719 tempest-TestStampPattern-1862550995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:57:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-27732c65-8806-4683-9647-e872c39a6a66 req-f1c85066-e153-442e-9d36-dd0aec564719 tempest-TestStampPattern-1862550995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-12fbb268-d57b-46d3-9e91-c3f867590c01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5318b59a-5214-4542-bff1-f7073c2e2d47', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:57:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-27732c65-8806-4683-9647-e872c39a6a66 req-f1c85066-e153-442e-9d36-dd0aec564719 tempest-TestStampPattern-1862550995 None] attachment_update completed successfully. Nov 02 10:57:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-983fd71a-d385-40bb-932c-12f8e8b4cce8 req-68e609f5-9ab0-4ca0-968d-78b9479d60b5 tempest-TestStampPattern-1862550995 None] Terminate volume connection completed successfully. Nov 02 10:57:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-983fd71a-d385-40bb-932c-12f8e8b4cce8 req-68e609f5-9ab0-4ca0-968d-78b9479d60b5 tempest-TestStampPattern-1862550995 None] Deleting attachment 5318b59a-5214-4542-bff1-f7073c2e2d47. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:57:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:57:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:57:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Creating offline snapshot 78958f0a-af33-4c2a-9760-152ddc6d73b9 of volume 12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:57:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[588409e1-5486-41ff-9b9c-d15d805c4dbe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:57:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:57 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:57:57 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:58 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.722s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:58 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 1G Nov 02 10:57:58 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:58 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 1G" returned: 0 in 0.703s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fbb268-d57b-46d3-9e91-c3f867590c01 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:58 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fbb268-d57b-46d3-9e91-c3f867590c01 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:57:58 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:59 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fbb268-d57b-46d3-9e91-c3f867590c01 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:59 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 is being set with open permissions: ugo+rw Nov 02 10:57:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:59 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:57:59 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:57:59 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 02 10:57:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:57:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:57:59 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info Nov 02 10:57:59 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:00 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:00 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info is being set with open permissions: ugo+rw Nov 02 10:58:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:00 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info Nov 02 10:58:00 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:00 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.info" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.248s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b99b4fc3-1309-4513-858e-c43ec3e20899 tempest-TestStampPattern-1862550995 None] Create snapshot completed successfully Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:09 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:58:09 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:10 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:58:10 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Flow 'volume_create_manager' (95ed2fb8-d243-4ac5-9ee3-10324ae8b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a69c874-9445-42aa-9e79-b0549e890884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a69c874-9445-42aa-9e79-b0549e890884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-405934844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6268ee08-db0b-46c7-8b3f-193de9a30dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b66dc8da09bb43bab49ce67af95bf039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78958f0a-af33-4c2a-9760-152ddc6d73b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:13Z,use_quota=True,user_id='1dfc8fa9adf1493b9c40fe4e40d568ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65dbc99-5118-4740-bde8-652642ff0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65dbc99-5118-4740-bde8-652642ff0027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1645da4-b77d-475f-b38c-c0c16c5e75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1645da4-b77d-475f-b38c-c0c16c5e75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6268ee08-db0b-46c7-8b3f-193de9a30dc6', 'volume_name': 'volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6', 'volume_size': 1, 'snapshot_id': '78958f0a-af33-4c2a-9760-152ddc6d73b9'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927afe2d-d97b-4569-b2e2-7ca96873939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927afe2d-d97b-4569-b2e2-7ca96873939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ffab4-892c-4437-b7b1-eca9020adaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Volume 6268ee08-db0b-46c7-8b3f-193de9a30dc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6', 'volume_size': 1, 'snapshot_id': '78958f0a-af33-4c2a-9760-152ddc6d73b9'} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9-6268ee08-db0b-46c7-8b3f-193de9a30dc6" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9-6268ee08-db0b-46c7-8b3f-193de9a30dc6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Creating volume 6268ee08-db0b-46c7-8b3f-193de9a30dc6 from snapshot 78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] snapshot: 78958f0a-af33-4c2a-9760-152ddc6d73b9, volume: 6268ee08-db0b-46c7-8b3f-193de9a30dc6, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[95712fd8-3928-4ae8-ad89-6ec227f519c5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:58:13 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:13 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12fbb268-d57b-46d3-9e91-c3f867590c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6244146-ff19-4d20-a124-6e128a1d7d21]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:58:13 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:13 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.482s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 10:58:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:13 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 Nov 02 10:58:13 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:18 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Flow 'volume_create_manager' (95601eb2-e609-4339-8eed-0eb3394b36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc696634-0d48-47c5-ab91-c58bf1b031fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc696634-0d48-47c5-ab91-c58bf1b031fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-310345287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c6eb87-4927-46e3-b623-016200dfb74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0876e13a0c458a8a03300f5d232789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:19Z,use_quota=True,user_id='b5ce8fa585244c58935a9c0767ae9138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a3b2d-81b2-484f-b891-e73fc038f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a3b2d-81b2-484f-b891-e73fc038f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84786a3a-85cb-4b93-bdce-62988b906136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84786a3a-85cb-4b93-bdce-62988b906136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07c6eb87-4927-46e3-b623-016200dfb74f', 'volume_name': 'volume-07c6eb87-4927-46e3-b623-016200dfb74f', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49d11e5-d6da-46a7-8573-af2d13c8a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49d11e5-d6da-46a7-8573-af2d13c8a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c805a503-14d6-4a3d-9210-13337fba8bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Volume 07c6eb87-4927-46e3-b623-016200dfb74f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07c6eb87-4927-46e3-b623-016200dfb74f', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 10:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Trying to clone 07c6eb87-4927-46e3-b623-016200dfb74f from image 134ee211-162c-468b-b66a-c0628be004d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 10:58:21 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD, size 20.69 MB, duration 1.30 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 10:58:21 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Image download 20.69 MB at 15.97 MB/s Nov 02 10:58:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd006d7d-1392-4cec-ae89-21ca729a5cbe]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:21 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD Nov 02 10:58:21 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:22 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:22 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 is fetched for user b5ce8fa585244c58935a9c0767ae9138. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 10:58:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ab3c2-face-493d-9fb6-666615d03a40]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:22 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD Nov 02 10:58:22 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:23 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD" returned: 0 in 1.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:25 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6" returned: 0 in 11.657s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:25 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01, size 1024.00 MB, duration 11.66 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:58:25 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Converted 1024.00 MB image at 87.82 MB/s Nov 02 10:58:25 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 is being set with open permissions: ugo+rw Nov 02 10:58:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:25 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 Nov 02 10:58:25 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:25 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" released by "_copy_volume_from_snapshot" :: held 13.122s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9-6268ee08-db0b-46c7-8b3f-193de9a30dc6" released by "_create_volume_from_snapshot" :: held 13.262s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.280s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-310345287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c6eb87-4927-46e3-b623-016200dfb74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0876e13a0c458a8a03300f5d232789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:19Z,use_quota=True,user_id='b5ce8fa585244c58935a9c0767ae9138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Creating volume 07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:26 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1073741824 Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ffab4-892c-4437-b7b1-eca9020adaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6', 'volume_size': 1, 'snapshot_id': '78958f0a-af33-4c2a-9760-152ddc6d73b9'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ff044-11ea-4a2f-8ca6-174a65184b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:26 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Volume volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 (6268ee08-db0b-46c7-8b3f-193de9a30dc6): created successfully Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ff044-11ea-4a2f-8ca6-174a65184b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Flow 'volume_create_manager' (95ed2fb8-d243-4ac5-9ee3-10324ae8b152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a3f4d464-c1fc-4c8e-90fa-f17504eac196 tempest-TestStampPattern-1862550995 None] Created volume successfully. Nov 02 10:58:26 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1073741824" returned: 0 in 0.842s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c7b34782-ab69-446e-a03f-2434636bffa6 req-f203f51b-4c01-4491-8a4e-94c3ab1ffca0 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:26 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f Nov 02 10:58:26 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:27 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c7b34782-ab69-446e-a03f-2434636bffa6 req-f203f51b-4c01-4491-8a4e-94c3ab1ffca0 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.396s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c7b34782-ab69-446e-a03f-2434636bffa6 req-f203f51b-4c01-4491-8a4e-94c3ab1ffca0 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Attempting download of 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume 07c6eb87-4927-46e3-b623-016200dfb74f. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c7b34782-ab69-446e-a03f-2434636bffa6 req-f203f51b-4c01-4491-8a4e-94c3ab1ffca0 tempest-TestInstancesWithCinderVolumes-1368920707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adf36de1-b644-47f5-9a4a-0216c2b6475a', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8296300-3592-48a5-858a-edd6a3a7d442]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c7b34782-ab69-446e-a03f-2434636bffa6 req-f203f51b-4c01-4491-8a4e-94c3ab1ffca0 tempest-TestInstancesWithCinderVolumes-1368920707 None] attachment_update completed successfully. Nov 02 10:58:27 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm Nov 02 10:58:27 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:27 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:28 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm Nov 02 10:58:28 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:28 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm" returned: 1 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_134ee211-162c-468b-b66a-c0628be004d6_1lsaeasm' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 10:58:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d63cb1-7b67-45d8-93cc-b720ad54d729]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:28 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD Nov 02 10:58:28 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:29 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD" returned: 0 in 0.993s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:29 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] 134ee211-162c-468b-b66a-c0628be004d6 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 10:58:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:29 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f Nov 02 10:58:29 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4fda746d-a37b-4b5c-8c73-6920fbd30c96 req-122caae1-23de-455a-ae7c-61c1377e38e4 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4fda746d-a37b-4b5c-8c73-6920fbd30c96 req-122caae1-23de-455a-ae7c-61c1377e38e4 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4fda746d-a37b-4b5c-8c73-6920fbd30c96 req-122caae1-23de-455a-ae7c-61c1377e38e4 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-4fda746d-a37b-4b5c-8c73-6920fbd30c96 req-122caae1-23de-455a-ae7c-61c1377e38e4 tempest-TestInstancesWithCinderVolumes-1368920707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-097afa02-3e2b-448e-8167-48b6fa61edad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83bc08ee-0a2d-495c-b477-1e2fc2f7b6c7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:58:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-4fda746d-a37b-4b5c-8c73-6920fbd30c96 req-122caae1-23de-455a-ae7c-61c1377e38e4 tempest-TestInstancesWithCinderVolumes-1368920707 None] attachment_update completed successfully. Nov 02 10:58:33 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f" returned: 0 in 4.114s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_134ee211-162c-468b-b66a-c0628be004d6_6gmgbbhgdevstack@QuobyteHD, size 112.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 10:58:33 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Converted 112.00 MB image at 27.21 MB/s Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:33 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1G Nov 02 10:58:33 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:33 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f 1G" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Downloaded image 134ee211-162c-468b-b66a-c0628be004d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}])) to volume 07c6eb87-4927-46e3-b623-016200dfb74f successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Temporary image 134ee211-162c-468b-b66a-c0628be004d6 for user b5ce8fa585244c58935a9c0767ae9138 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 10:58:33 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Marking volume 07c6eb87-4927-46e3-b623-016200dfb74f as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Copying metadata from image 134ee211-162c-468b-b66a-c0628be004d6 to 07c6eb87-4927-46e3-b623-016200dfb74f. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Creating volume glance metadata for volume 07c6eb87-4927-46e3-b623-016200dfb74f backed by image 134ee211-162c-468b-b66a-c0628be004d6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c805a503-14d6-4a3d-9210-13337fba8bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c6eb87-4927-46e3-b623-016200dfb74f', 'volume_size': 1, 'image_id': '134ee211-162c-468b-b66a-c0628be004d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/134ee211-162c-468b-b66a-c0628be004d6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6e4fd117aa3a498ea6dda05f4614c117', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '134ee211-162c-468b-b66a-c0628be004d6', 'created_at': datetime.datetime(2026, 11, 2, 9, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/134ee211-162c-468b-b66a-c0628be004d6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8219a547-93a0-4e2b-8d80-16b1215c45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Volume volume-07c6eb87-4927-46e3-b623-016200dfb74f (07c6eb87-4927-46e3-b623-016200dfb74f): created successfully Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8219a547-93a0-4e2b-8d80-16b1215c45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Flow 'volume_create_manager' (95601eb2-e609-4339-8eed-0eb3394b36bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9eb7e8d0-18ff-48de-b1e1-46615954a24d tempest-TestShelveInstance-1719968652 None] Created volume successfully. Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7234476c-3179-41d4-b5e8-471f2157ed8f req-cebc1675-1fa4-467a-94ac-929e111fa415 tempest-TestShelveInstance-1719968652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7234476c-3179-41d4-b5e8-471f2157ed8f req-cebc1675-1fa4-467a-94ac-929e111fa415 tempest-TestShelveInstance-1719968652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-7234476c-3179-41d4-b5e8-471f2157ed8f req-cebc1675-1fa4-467a-94ac-929e111fa415 tempest-TestShelveInstance-1719968652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Flow 'volume_create_manager' (8aa39090-39d9-4f3b-bf1a-77aacccbc69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d10f944-59dc-42f2-9137-768fbc112903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d10f944-59dc-42f2-9137-768fbc112903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007249599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d127a6-9ea0-434c-a200-b954a2ba8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a8ed7c1b374a8c967d1fe7167ff2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='095c0b92490840cf9a0d5ba42d897dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e25338-cc68-499c-b033-275a6535b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e25338-cc68-499c-b033-275a6535b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c19b09-2eb4-4296-9606-572692b35477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c19b09-2eb4-4296-9606-572692b35477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d127a6-9ea0-434c-a200-b954a2ba8574', 'volume_name': 'volume-55d127a6-9ea0-434c-a200-b954a2ba8574', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025c205e-d70a-4117-9af7-1cdd72daab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025c205e-d70a-4117-9af7-1cdd72daab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28f1b9d-b2aa-4910-ad5a-34f884cd83a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Volume 55d127a6-9ea0-434c-a200-b954a2ba8574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d127a6-9ea0-434c-a200-b954a2ba8574', 'volume_size': 1} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1007249599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d127a6-9ea0-434c-a200-b954a2ba8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a8ed7c1b374a8c967d1fe7167ff2bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:58:42Z,use_quota=True,user_id='095c0b92490840cf9a0d5ba42d897dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Creating volume 55d127a6-9ea0-434c-a200-b954a2ba8574 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:58:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:42 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 1073741824 Nov 02 10:58:42 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-7234476c-3179-41d4-b5e8-471f2157ed8f req-cebc1675-1fa4-467a-94ac-929e111fa415 tempest-TestShelveInstance-1719968652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-07c6eb87-4927-46e3-b623-016200dfb74f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72933536-6491-4aeb-9034-4740a7a38eb6', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:58:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-72c9dd70-1147-493d-8cd7-592898a2e9d2 req-86fc8581-43a2-40dd-b052-bfcc6a02f6c1 tempest-TestInstancesWithCinderVolumes-1368920707 None] Terminate volume connection completed successfully. Nov 02 10:58:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-72c9dd70-1147-493d-8cd7-592898a2e9d2 req-86fc8581-43a2-40dd-b052-bfcc6a02f6c1 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleting attachment adf36de1-b644-47f5-9a4a-0216c2b6475a. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:58:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-7234476c-3179-41d4-b5e8-471f2157ed8f req-cebc1675-1fa4-467a-94ac-929e111fa415 tempest-TestShelveInstance-1719968652 None] attachment_update completed successfully. Nov 02 10:58:43 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 1073741824" returned: 0 in 1.173s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:43 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 Nov 02 10:58:43 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-4a02f2c5-3134-4dba-a946-ee53c6ebb16e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-4a02f2c5-3134-4dba-a946-ee53c6ebb16e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-quobyte-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c606bb-67a9-4d50-89c8-399ecad6542e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e Nov 02 10:58:44 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:44 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28f1b9d-b2aa-4910-ad5a-34f884cd83a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d127a6-9ea0-434c-a200-b954a2ba8574', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3b033-1e42-4c98-b61d-82cb8da7a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:58:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Volume volume-55d127a6-9ea0-434c-a200-b954a2ba8574 (55d127a6-9ea0-434c-a200-b954a2ba8574): created successfully Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3b033-1e42-4c98-b61d-82cb8da7a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Flow 'volume_create_manager' (8aa39090-39d9-4f3b-bf1a-77aacccbc69e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:58:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d2cbfd8d-8c5e-4c5f-b097-6877b603fcfe tempest-TestMinimumBasicScenario-176765795 None] Created volume successfully. Nov 02 10:58:44 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" returned: 0 in 0.655s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:44 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e Nov 02 10:58:44 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-4a02f2c5-3134-4dba-a946-ee53c6ebb16e" released by "delete_volume" :: held 1.110s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:45 devstack cinder-volume[86783]: WARNING cinder.quota [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1533669356-168642845 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1533669356-168642845, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:58:45 devstack cinder-volume[86783]: WARNING cinder.quota [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1533669356-168642845 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1533669356-168642845, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Created reservations ['4b5327ea-5001-4b0e-bdb2-dfdfa93fc764', '624d7cf2-82db-48e2-898b-296470b3d19e', '2d637341-d7d9-4ded-8dbb-0b311551bd99', '5c1f5dac-4f46-498b-8bd5-eeca7e002edd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:45 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:58:45 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:45 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.605s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleted volume successfully. Nov 02 10:58:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34e2783a-a19f-4d91-a447-bbd35f25d4bf tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-4a02f2c5-3134-4dba-a946-ee53c6ebb16e-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-bc8c8ae3-7a7f-4870-8265-44ea49ad00ac req-b148b2bd-661c-4807-ab2f-488c0eaec896 tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-bc8c8ae3-7a7f-4870-8265-44ea49ad00ac req-b148b2bd-661c-4807-ab2f-488c0eaec896 tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-bc8c8ae3-7a7f-4870-8265-44ea49ad00ac req-b148b2bd-661c-4807-ab2f-488c0eaec896 tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-bc8c8ae3-7a7f-4870-8265-44ea49ad00ac req-b148b2bd-661c-4807-ab2f-488c0eaec896 tempest-TestMinimumBasicScenario-176765795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-55d127a6-9ea0-434c-a200-b954a2ba8574', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c564ecc-9fb1-4bf2-9640-d62dbb35f2f0', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:58:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-bc8c8ae3-7a7f-4870-8265-44ea49ad00ac req-b148b2bd-661c-4807-ab2f-488c0eaec896 tempest-TestMinimumBasicScenario-176765795 None] attachment_update completed successfully. Nov 02 10:58:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-2c9b1dcd-9bc7-4b46-9234-b7aab1011d27 req-d2070d97-16e4-4a1f-8ad4-5a7125b80499 tempest-TestInstancesWithCinderVolumes-1368920707 None] Terminate volume connection completed successfully. Nov 02 10:58:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-2c9b1dcd-9bc7-4b46-9234-b7aab1011d27 req-d2070d97-16e4-4a1f-8ad4-5a7125b80499 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleting attachment 83bc08ee-0a2d-495c-b477-1e2fc2f7b6c7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-097afa02-3e2b-448e-8167-48b6fa61edad-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-097afa02-3e2b-448e-8167-48b6fa61edad-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-quobyte-097afa02-3e2b-448e-8167-48b6fa61edad" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-097afa02-3e2b-448e-8167-48b6fa61edad" acquired by "delete_volume" :: waited 0.062s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7560fda4-a2a2-4085-8872-82757734c899]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:58:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:51 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad Nov 02 10:58:51 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad" returned: 0 in 1.063s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:52 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad Nov 02 10:58:52 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:52 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-097afa02-3e2b-448e-8167-48b6fa61edad" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-097afa02-3e2b-448e-8167-48b6fa61edad" released by "delete_volume" :: held 1.624s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:58:52 devstack cinder-volume[86783]: WARNING cinder.quota [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842006162-2016130759 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842006162-2016130759, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:58:52 devstack cinder-volume[86783]: WARNING cinder.quota [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842006162-2016130759 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842006162-2016130759, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:58:52 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Created reservations ['4d614418-48e6-42e8-a411-54826b9e385c', '1b9164c1-26d1-4b03-9332-c0890d415db8', '13f972ec-b474-4882-9449-e407350b9d83', 'a0a019b4-5e8e-460c-93e8-abb9d3467c9f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:58:53 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:58:53 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:58:53 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:58:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleted volume successfully. Nov 02 10:58:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-53f618a7-5d29-4ae0-8719-b915572d7e98 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-097afa02-3e2b-448e-8167-48b6fa61edad-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-345e8f70-e08a-4529-ab39-46dfb04b8b5e req-eede7a57-7746-4d93-b470-b51977e61823 tempest-TestInstancesWithCinderVolumes-1368920707 None] Terminate volume connection completed successfully. Nov 02 10:59:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-345e8f70-e08a-4529-ab39-46dfb04b8b5e req-eede7a57-7746-4d93-b470-b51977e61823 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleting attachment e8d2e47e-ae4f-41e6-ad2a-c81d24b21eeb. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:59:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-b71a32d8-e27e-4982-962d-db7b7c944f52-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-b71a32d8-e27e-4982-962d-db7b7c944f52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "cinder-quobyte-b71a32d8-e27e-4982-962d-db7b7c944f52" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-b71a32d8-e27e-4982-962d-db7b7c944f52" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[596d2f72-cecc-4c19-b633-fc29b3ae9413]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 Nov 02 10:59:02 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52" returned: 0 in 0.403s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52 Nov 02 10:59:02 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:02 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b71a32d8-e27e-4982-962d-db7b7c944f52" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-quobyte-b71a32d8-e27e-4982-962d-db7b7c944f52" released by "delete_volume" :: held 0.727s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018941541-256942694 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018941541-256942694, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:59:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018941541-256942694 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018941541-256942694, it is now deprecated. Please use the default quota class for default quota. Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Created reservations ['026b7bb0-7a01-47c1-a42e-9467d4523c8f', 'a7c05c0c-fde5-4f3e-873a-a733c4bd40b8', '3bb8fe73-d800-4cbc-8c1a-ec5f62cf1465', '3971a35e-05c8-40fe-b026-b28d65b03e51'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:02 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:59:02 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:03 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.321s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Deleted volume successfully. Nov 02 10:59:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a0afa6b-ec04-4037-aac8-e4df383aee13 tempest-TestInstancesWithCinderVolumes-1368920707 None] Lock "cinder-b71a32d8-e27e-4982-962d-db7b7c944f52-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:09 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:59:09 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:09 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 10:59:12 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=36,cinder:SELECT=65,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:59:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=53,cinder:UPDATE=45,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:59:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a0e905c8-e0fa-48ea-a216-bc925c9eb857 req-e0df8b49-31da-4b5a-a621-e18ca1400e95 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a0e905c8-e0fa-48ea-a216-bc925c9eb857 req-e0df8b49-31da-4b5a-a621-e18ca1400e95 tempest-TestStampPattern-1862550995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a0e905c8-e0fa-48ea-a216-bc925c9eb857 req-e0df8b49-31da-4b5a-a621-e18ca1400e95 tempest-TestStampPattern-1862550995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a0e905c8-e0fa-48ea-a216-bc925c9eb857 req-e0df8b49-31da-4b5a-a621-e18ca1400e95 tempest-TestStampPattern-1862550995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7a21f4f-1c54-4096-964d-b5c74caf6ebf', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:59:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a0e905c8-e0fa-48ea-a216-bc925c9eb857 req-e0df8b49-31da-4b5a-a621-e18ca1400e95 tempest-TestStampPattern-1862550995 None] attachment_update completed successfully. Nov 02 10:59:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-268aae9a-298c-4b2b-b078-844238e23f08 req-7ee368b0-e2cc-4d8a-b04b-061829279a77 tempest-TestStampPattern-1862550995 None] Terminate volume connection completed successfully. Nov 02 10:59:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-268aae9a-298c-4b2b-b078-844238e23f08 req-7ee368b0-e2cc-4d8a-b04b-061829279a77 tempest-TestStampPattern-1862550995 None] Deleting attachment d7a21f4f-1c54-4096-964d-b5c74caf6ebf. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:59:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-6268ee08-db0b-46c7-8b3f-193de9a30dc6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "cinder-6268ee08-db0b-46c7-8b3f-193de9a30dc6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e11eb-3a2f-4cf6-92a7-386dcbf58e30]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:25 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 Nov 02 10:59:25 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6" returned: 0 in 1.104s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6 Nov 02 10:59:26 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-314abaab-3882-4ff6-b56f-2d847aeadd80 req-b168e763-9e51-4239-b616-daa7eb9152cc tempest-TestShelveInstance-1719968652 None] Terminate volume connection completed successfully. Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-314abaab-3882-4ff6-b56f-2d847aeadd80 req-b168e763-9e51-4239-b616-daa7eb9152cc tempest-TestShelveInstance-1719968652 None] Deleting attachment 72933536-6491-4aeb-9034-4740a7a38eb6. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:59:26 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6268ee08-db0b-46c7-8b3f-193de9a30dc6" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-6268ee08-db0b-46c7-8b3f-193de9a30dc6" released by "delete_volume" :: held 1.560s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Created reservations ['e1840a74-c7e5-4597-b9b5-fd28613ffe87', 'fc7faee4-d7b1-44de-9791-dd57311cf36b', 'd4555b69-03cc-4fd1-873a-29939cd3fbc9', 'dc9cd5cb-fde6-4498-bb39-33e97de35cf3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:26 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:59:26 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:27 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Deleted volume successfully. Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c1c0895-1cf0-4312-b02a-f220b4a04948 tempest-TestStampPattern-1862550995 None] Lock "cinder-6268ee08-db0b-46c7-8b3f-193de9a30dc6-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-78958f0a-af33-4c2a-9760-152ddc6d73b9-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-78958f0a-af33-4c2a-9760-152ddc6d73b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Deleting offline snapshot 78958f0a-af33-4c2a-9760-152ddc6d73b9 of volume 12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] snapshot_file for this snap is: volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2067d00e-8b50-4649-866a-ddc28246222d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:27 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:59:27 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.445s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12fbb268-d57b-46d3-9e91-c3f867590c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e963d7-3818-453d-a121-3894b853ca90]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:28 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:59:28 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:28 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.659s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:29 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:59:29 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:29 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:29 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9 Nov 02 10:59:29 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:29 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01.78958f0a-af33-4c2a-9760-152ddc6d73b9" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-78958f0a-af33-4c2a-9760-152ddc6d73b9" released by "_delete_snapshot" :: held 2.143s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" released by "delete_snapshot" :: held 2.183s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Created reservations ['6e58054d-515a-45a3-a757-10cf52ec147e', '73160914-e699-4710-a313-030ee1bd7650', '9ad9cea1-1943-4f18-a1be-e2fae2c4dcf3', '9f59b3dd-baa2-4547-9c7b-c64c6f3b33ba'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Delete snapshot completed successfully. Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-36fd3c0c-ce4a-4fe9-8c15-9fb700811f2c req-56a4177e-cbec-4bb0-8485-7b10db235387 tempest-TestShelveInstance-1719968652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-36fd3c0c-ce4a-4fe9-8c15-9fb700811f2c req-56a4177e-cbec-4bb0-8485-7b10db235387 tempest-TestShelveInstance-1719968652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21a85a9-c9ef-4d98-8a3c-e2949190dde5 tempest-TestStampPattern-1862550995 None] Lock "cinder-78958f0a-af33-4c2a-9760-152ddc6d73b9-delete_snapshot" released by "delete_snapshot" :: held 2.441s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-36fd3c0c-ce4a-4fe9-8c15-9fb700811f2c req-56a4177e-cbec-4bb0-8485-7b10db235387 tempest-TestShelveInstance-1719968652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-36fd3c0c-ce4a-4fe9-8c15-9fb700811f2c req-56a4177e-cbec-4bb0-8485-7b10db235387 tempest-TestShelveInstance-1719968652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-07c6eb87-4927-46e3-b623-016200dfb74f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'affd00a8-79bd-4039-994f-16ece928a231', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 10:59:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-36fd3c0c-ce4a-4fe9-8c15-9fb700811f2c req-56a4177e-cbec-4bb0-8485-7b10db235387 tempest-TestShelveInstance-1719968652 None] attachment_update completed successfully. Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-12fbb268-d57b-46d3-9e91-c3f867590c01-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "cinder-12fbb268-d57b-46d3-9e91-c3f867590c01-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Acquiring lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98099dc-d8bd-4fe5-a2f6-cb880223c559]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:36 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:59:36 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.642s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:37 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01 Nov 02 10:59:37 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:37 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12fbb268-d57b-46d3-9e91-c3f867590c01" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "cinder-quobyte-12fbb268-d57b-46d3-9e91-c3f867590c01" released by "delete_volume" :: held 1.214s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Created reservations ['b783b30b-c5f6-4058-b53f-3dbb5fbe6a21', '949266a8-7b83-4d8b-a7be-06bae3ef66e3', 'b79532ef-5420-469b-bc91-521670c37fe8', '6cf9d120-5a4a-4450-a731-d04ef394ee5e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:38 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:59:38 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:38 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.510s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Deleted volume successfully. Nov 02 10:59:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-75aa8fb2-d317-4117-b209-5faac011509a tempest-TestStampPattern-1862550995 None] Lock "cinder-12fbb268-d57b-46d3-9e91-c3f867590c01-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Flow 'volume_create_manager' (4c53505d-93b9-47e9-8c78-064fee63962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a4de23-d429-4e0b-95dc-d171c705e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a4de23-d429-4e0b-95dc-d171c705e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1042006219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2bfd65-b65b-4a24-a021-714960ef292b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd1bf7d94b4188804c06cf6cadda25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:47Z,use_quota=True,user_id='cc7822ff509240a38aa56276b8617065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b33bda4-7612-42e1-95ef-dd85e146ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b33bda4-7612-42e1-95ef-dd85e146ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab2399-f367-4a8c-9075-d8f1d1d028a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab2399-f367-4a8c-9075-d8f1d1d028a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2bfd65-b65b-4a24-a021-714960ef292b', 'volume_name': 'volume-8f2bfd65-b65b-4a24-a021-714960ef292b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08c80bc-afc3-4b12-8b55-584bd2642ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08c80bc-afc3-4b12-8b55-584bd2642ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1856bf50-62ec-4249-bff3-4379f6ff9e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume 8f2bfd65-b65b-4a24-a021-714960ef292b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2bfd65-b65b-4a24-a021-714960ef292b', 'volume_size': 1} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1042006219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2bfd65-b65b-4a24-a021-714960ef292b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd1bf7d94b4188804c06cf6cadda25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:47Z,use_quota=True,user_id='cc7822ff509240a38aa56276b8617065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Creating volume 8f2bfd65-b65b-4a24-a021-714960ef292b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:47 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b 1073741824 Nov 02 10:59:47 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Flow 'volume_create_manager' (96b5574d-db1b-4814-8d1e-962cbb3098ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34e59a5-2908-448b-92f9-8d698dd8cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34e59a5-2908-448b-92f9-8d698dd8cfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1277050011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b4727b-58ab-4696-8f87-7e12c18c64c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd1bf7d94b4188804c06cf6cadda25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:48Z,use_quota=True,user_id='cc7822ff509240a38aa56276b8617065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e5cd7-2325-4e75-af6a-4436218dd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e5cd7-2325-4e75-af6a-4436218dd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1bc63-31b4-4c06-b148-c17e20f882e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1bc63-31b4-4c06-b148-c17e20f882e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b4727b-58ab-4696-8f87-7e12c18c64c5', 'volume_name': 'volume-69b4727b-58ab-4696-8f87-7e12c18c64c5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c55939-b801-4274-801d-e24e88428865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c55939-b801-4274-801d-e24e88428865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d57d404-d91f-4a5d-88a5-95226e8607fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume 69b4727b-58ab-4696-8f87-7e12c18c64c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b4727b-58ab-4696-8f87-7e12c18c64c5', 'volume_size': 1} Nov 02 10:59:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:48 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b 1073741824" returned: 0 in 0.792s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b Nov 02 10:59:48 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1277050011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b4727b-58ab-4696-8f87-7e12c18c64c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abd1bf7d94b4188804c06cf6cadda25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:48Z,use_quota=True,user_id='cc7822ff509240a38aa56276b8617065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Creating volume 69b4727b-58ab-4696-8f87-7e12c18c64c5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:48 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1856bf50-62ec-4249-bff3-4379f6ff9e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2bfd65-b65b-4a24-a021-714960ef292b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ad152-9f9e-4d2f-9f37-7f607067e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:48 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 1073741824 Nov 02 10:59:48 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume volume-8f2bfd65-b65b-4a24-a021-714960ef292b (8f2bfd65-b65b-4a24-a021-714960ef292b): created successfully Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ad152-9f9e-4d2f-9f37-7f607067e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Flow 'volume_create_manager' (4c53505d-93b9-47e9-8c78-064fee63962b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3792e1d3-139e-436b-a4a8-e90894163eb1 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Created volume successfully. Nov 02 10:59:49 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 1073741824" returned: 0 in 0.614s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:49 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 Nov 02 10:59:49 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:49 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d57d404-d91f-4a5d-88a5-95226e8607fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b4727b-58ab-4696-8f87-7e12c18c64c5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8f6da0-aa06-48dc-a019-f4becf307509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Volume volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 (69b4727b-58ab-4696-8f87-7e12c18c64c5): created successfully Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8f6da0-aa06-48dc-a019-f4becf307509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Flow 'volume_create_manager' (96b5574d-db1b-4814-8d1e-962cbb3098ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c4c07dd9-2a60-4aa4-afbf-16cbd09f8858 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Created volume successfully. Nov 02 10:59:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-2817090c-4475-43f2-a191-5c78d9c0ca76 req-8c21f6ca-6120-4b08-97cd-00cef7ebc41a tempest-TestMinimumBasicScenario-176765795 None] Terminate volume connection completed successfully. Nov 02 10:59:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-2817090c-4475-43f2-a191-5c78d9c0ca76 req-8c21f6ca-6120-4b08-97cd-00cef7ebc41a tempest-TestMinimumBasicScenario-176765795 None] Deleting attachment 8c564ecc-9fb1-4bf2-9640-d62dbb35f2f0. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "cinder-55d127a6-9ea0-434c-a200-b954a2ba8574-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "cinder-55d127a6-9ea0-434c-a200-b954a2ba8574-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "cinder-quobyte-55d127a6-9ea0-434c-a200-b954a2ba8574" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "cinder-quobyte-55d127a6-9ea0-434c-a200-b954a2ba8574" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d7431-b435-4e62-9eb7-4f9bc894def4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:55 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 Nov 02 10:59:55 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (b8e8db12-f4c9-4ecb-b1b7-45eeee3e2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a06ec7-d301-47b6-b45a-72c83c7b054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a06ec7-d301-47b6-b45a-72c83c7b054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754477151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e38efbb-2fda-4e65-83e5-c83f60380953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:56Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836f0d05-1457-4c80-a1e9-a692902e84bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836f0d05-1457-4c80-a1e9-a692902e84bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb4fcd7-d4cd-4162-9879-01c9b1413a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb4fcd7-d4cd-4162-9879-01c9b1413a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e38efbb-2fda-4e65-83e5-c83f60380953', 'volume_name': 'volume-1e38efbb-2fda-4e65-83e5-c83f60380953', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36ea933-775c-47ac-9f82-f793efcd9d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36ea933-775c-47ac-9f82-f793efcd9d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8bd27f-19af-484b-9355-ffdea42e1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume 1e38efbb-2fda-4e65-83e5-c83f60380953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e38efbb-2fda-4e65-83e5-c83f60380953', 'volume_size': 1} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754477151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e38efbb-2fda-4e65-83e5-c83f60380953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:59:56Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume 1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:59:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 1073741824 Nov 02 10:59:56 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574 Nov 02 10:59:56 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55d127a6-9ea0-434c-a200-b954a2ba8574" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "cinder-quobyte-55d127a6-9ea0-434c-a200-b954a2ba8574" released by "delete_volume" :: held 0.845s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Created reservations ['bfae610a-0975-4d7a-925a-8e2546dc1d10', 'fecd9f3f-74de-402b-b733-25a5eb5fc0d0', '46a052a9-8559-48de-82d4-ed2b62245649', '70f28a0d-5739-472a-8c01-33a87b351c28'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:59:56 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 1073741824" returned: 0 in 0.594s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 10:59:56 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:56 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 Nov 02 10:59:56 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:57 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8bd27f-19af-484b-9355-ffdea42e1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e38efbb-2fda-4e65-83e5-c83f60380953', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134c0328-4118-44e1-bd98-e7f8afc605e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:59:57 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-1e38efbb-2fda-4e65-83e5-c83f60380953 (1e38efbb-2fda-4e65-83e5-c83f60380953): created successfully Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134c0328-4118-44e1-bd98-e7f8afc605e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (b8e8db12-f4c9-4ecb-b1b7-45eeee3e2c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:59:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Deleted volume successfully. Nov 02 10:59:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e77050ff-d1cc-4dcc-a5b0-e957f70a83f2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 10:59:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a35966f-3a17-49d4-9078-3d479a23e942 tempest-TestMinimumBasicScenario-176765795 None] Lock "cinder-55d127a6-9ea0-434c-a200-b954a2ba8574-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:59:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:59:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:59:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating offline snapshot 61e3fefc-2a9d-4b56-80e6-bf9c4d44151e of volume 1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:59:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e35b1e-b5c7-4936-846f-b5b2357534e1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:59:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:58 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 Nov 02 10:59:58 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:59:59 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 02 10:59:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:59:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:59:59 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e 1G Nov 02 10:59:59 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e 1G" returned: 0 in 0.727s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38efbb-2fda-4e65-83e5-c83f60380953 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38efbb-2fda-4e65-83e5-c83f60380953 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e Nov 02 11:00:00 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e38efbb-2fda-4e65-83e5-c83f60380953 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e is being set with open permissions: ugo+rw Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e Nov 02 11:00:00 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:00 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:00 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info Nov 02 11:00:00 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:01 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info" returned: 0 in 0.558s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:01 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info is being set with open permissions: ugo+rw Nov 02 11:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:01 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info Nov 02 11:00:01 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:02 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.info" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.530s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0074bf8b-83d9-4cf9-80c2-5eaf72666d92 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Create snapshot completed successfully Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (f5e7bcc7-04dd-46ee-8aa0-501731f77291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0dde8d-b4bf-4033-87d0-e84b259bdecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0dde8d-b4bf-4033-87d0-e84b259bdecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415266123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545bedb2-43c1-4e37-8f06-21a9da96705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:03Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216727bd-3fc8-431b-b635-8e8bfe3804dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216727bd-3fc8-431b-b635-8e8bfe3804dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1b89e-2dea-44a5-9a02-47264f8e56b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf1b89e-2dea-44a5-9a02-47264f8e56b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545bedb2-43c1-4e37-8f06-21a9da96705b', 'volume_name': 'volume-545bedb2-43c1-4e37-8f06-21a9da96705b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc925bf-dc52-4171-aa2d-6d1d4571a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc925bf-dc52-4171-aa2d-6d1d4571a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20869d98-1a45-4826-98b6-1e12a56ca11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume 545bedb2-43c1-4e37-8f06-21a9da96705b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545bedb2-43c1-4e37-8f06-21a9da96705b', 'volume_size': 1} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-415266123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545bedb2-43c1-4e37-8f06-21a9da96705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:03Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume 545bedb2-43c1-4e37-8f06-21a9da96705b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:03 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b 1073741824 Nov 02 11:00:03 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (760e8cbe-0628-4d91-b25e-6ed8a2dc883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37526377-6fec-481c-bb5e-6a41d4155588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37526377-6fec-481c-bb5e-6a41d4155588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341942377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a79d789-b0fd-4877-acc1-3978ff06b1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:04Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c89904-170b-4446-b8a4-938e73e764f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c89904-170b-4446-b8a4-938e73e764f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31870609-36cd-431f-817b-24e59f266b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31870609-36cd-431f-817b-24e59f266b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a79d789-b0fd-4877-acc1-3978ff06b1ac', 'volume_name': 'volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd89591a-b130-4663-8b74-96b1939a2d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd89591a-b130-4663-8b74-96b1939a2d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1729a97-a3cb-4bf6-971c-512400ea897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume 2a79d789-b0fd-4877-acc1-3978ff06b1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac', 'volume_size': 1} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:04 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b 1073741824" returned: 0 in 0.856s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:04 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b Nov 02 11:00:04 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:04 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (bb210000-93e4-4aeb-b06a-1b288f9571e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050698e7-9811-4ec5-8c65-0bd86592417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341942377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a79d789-b0fd-4877-acc1-3978ff06b1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:04Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume 2a79d789-b0fd-4877-acc1-3978ff06b1ac {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050698e7-9811-4ec5-8c65-0bd86592417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397704193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d2760b-4cf8-4012-af2f-e7b7d5b6a769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:05Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dea00d-97ab-429a-b92a-197d62934d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19dea00d-97ab-429a-b92a-197d62934d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8d4005-8898-4ee6-ae3f-db1f98a324bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8d4005-8898-4ee6-ae3f-db1f98a324bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d2760b-4cf8-4012-af2f-e7b7d5b6a769', 'volume_name': 'volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac 1073741824 Nov 02 11:00:05 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb59ff09-dd98-4c02-a262-87533d823ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb59ff09-dd98-4c02-a262-87533d823ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e47ef95-d31d-4b47-9169-b006683e3795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume d4d2760b-4cf8-4012-af2f-e7b7d5b6a769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769', 'volume_size': 1} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20869d98-1a45-4826-98b6-1e12a56ca11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545bedb2-43c1-4e37-8f06-21a9da96705b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df002771-958b-4dcc-9511-ef81e0bbc935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-545bedb2-43c1-4e37-8f06-21a9da96705b (545bedb2-43c1-4e37-8f06-21a9da96705b): created successfully Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df002771-958b-4dcc-9511-ef81e0bbc935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (f5e7bcc7-04dd-46ee-8aa0-501731f77291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3536a129-0a60-45e6-9173-9bd1a0e0b2a1 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (31692391-3790-4e98-8a44-32e357bd0ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c5b81f-d537-4396-b741-f3cf4c7d5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c5b81f-d537-4396-b741-f3cf4c7d5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-768852658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e50bbb0-1736-4a98-8da5-90c3e41d1673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0626fa-11f7-4b1d-9bdc-0fbf30a9730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0626fa-11f7-4b1d-9bdc-0fbf30a9730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8444c53-33b3-4c8d-8676-213062313dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8444c53-33b3-4c8d-8676-213062313dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e50bbb0-1736-4a98-8da5-90c3e41d1673', 'volume_name': 'volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180ce60a-415d-4ab6-a5af-2cba645c63a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180ce60a-415d-4ab6-a5af-2cba645c63a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45940a9-2cf3-4a62-99a8-8aaf474e1e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume 0e50bbb0-1736-4a98-8da5-90c3e41d1673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673', 'volume_size': 1} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:05 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac 1073741824" returned: 0 in 0.800s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:05 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac Nov 02 11:00:05 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (b54b360d-55ff-4c58-aa17-6630eb9ecc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66356820-8f1b-47c2-8829-9587f92267fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66356820-8f1b-47c2-8829-9587f92267fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445947671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84779f0e-866f-44c9-990a-5d8710b0c27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37777d37-425d-4245-9d52-15d51ece13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37777d37-425d-4245-9d52-15d51ece13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c060854-6b77-431d-8b50-c08cf7222729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c060854-6b77-431d-8b50-c08cf7222729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84779f0e-866f-44c9-990a-5d8710b0c27f', 'volume_name': 'volume-84779f0e-866f-44c9-990a-5d8710b0c27f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5126ed70-cd81-4b09-8773-6515f3b386c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5126ed70-cd81-4b09-8773-6515f3b386c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1618402-eecb-42ad-96ee-ea35e204789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume 84779f0e-866f-44c9-990a-5d8710b0c27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84779f0e-866f-44c9-990a-5d8710b0c27f', 'volume_size': 1} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:06 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.060s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397704193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d2760b-4cf8-4012-af2f-e7b7d5b6a769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:05Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:06 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1729a97-a3cb-4bf6-971c-512400ea897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ae44f7-12c4-4ac1-abe3-4d6a8880bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:06 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 1073741824 Nov 02 11:00:06 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac (2a79d789-b0fd-4877-acc1-3978ff06b1ac): created successfully Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ae44f7-12c4-4ac1-abe3-4d6a8880bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (760e8cbe-0628-4d91-b25e-6ed8a2dc883b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2795bfbc-5e74-4be0-a84b-b3d4d047b1fb tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 11:00:06 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 1073741824" returned: 0 in 0.599s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:06 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 Nov 02 11:00:06 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:07 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-768852658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e50bbb0-1736-4a98-8da5-90c3e41d1673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume 0e50bbb0-1736-4a98-8da5-90c3e41d1673 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e47ef95-d31d-4b47-9169-b006683e3795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8abcd4e-a183-4678-ba6c-dde48f53aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:07 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 1073741824 Nov 02 11:00:07 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 (d4d2760b-4cf8-4012-af2f-e7b7d5b6a769): created successfully Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8abcd4e-a183-4678-ba6c-dde48f53aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (bb210000-93e4-4aeb-b06a-1b288f9571e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c56ba2cc-c097-4d9e-a9f4-ee0666ce00bd tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 11:00:07 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 1073741824" returned: 0 in 0.585s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:07 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 Nov 02 11:00:07 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:08 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-445947671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84779f0e-866f-44c9-990a-5d8710b0c27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd47afa67c1d4c6f89b1036effd0bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:06Z,use_quota=True,user_id='c044928c43ee4afb87563256f96db017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Creating volume 84779f0e-866f-44c9-990a-5d8710b0c27f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45940a9-2cf3-4a62-99a8-8aaf474e1e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:08 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f 1073741824 Nov 02 11:00:08 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e821d-4076-4162-b6e4-396fd46baf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 (0e50bbb0-1736-4a98-8da5-90c3e41d1673): created successfully Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e821d-4076-4162-b6e4-396fd46baf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (31692391-3790-4e98-8a44-32e357bd0ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7a3ac880-f818-4131-bb7b-affdb3963790 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 11:00:08 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f 1073741824" returned: 0 in 0.628s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:08 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f Nov 02 11:00:08 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1618402-eecb-42ad-96ee-ea35e204789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84779f0e-866f-44c9-990a-5d8710b0c27f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bafbd3d-9497-4d4a-96f5-a2e068e69e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Volume volume-84779f0e-866f-44c9-990a-5d8710b0c27f (84779f0e-866f-44c9-990a-5d8710b0c27f): created successfully Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bafbd3d-9497-4d4a-96f5-a2e068e69e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Flow 'volume_create_manager' (b54b360d-55ff-4c58-aa17-6630eb9ecc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a17e30aa-4d63-44ec-90db-c916bb6e52fc tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created volume successfully. Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:09 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-84779f0e-866f-44c9-990a-5d8710b0c27f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-84779f0e-866f-44c9-990a-5d8710b0c27f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-84779f0e-866f-44c9-990a-5d8710b0c27f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-84779f0e-866f-44c9-990a-5d8710b0c27f" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98304f-5c57-496e-93c0-ede618f86687]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:09 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:00:10 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f Nov 02 11:00:10 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:10 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f" returned: 0 in 0.431s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:10 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f Nov 02 11:00:10 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:10 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-84779f0e-866f-44c9-990a-5d8710b0c27f" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-84779f0e-866f-44c9-990a-5d8710b0c27f" released by "delete_volume" :: held 0.760s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['58a2fe1a-fa80-48e4-ab38-b0546969c145', 'bb9e656e-5b9a-44b2-8917-05bfff3a833d', '8e1265be-5be4-4c85-82ca-8b24585a987e', '38a629c7-ac3f-42a0-a6ce-239f720dbb5b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:10 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:10 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-0e50bbb0-1736-4a98-8da5-90c3e41d1673-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-0e50bbb0-1736-4a98-8da5-90c3e41d1673-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-0e50bbb0-1736-4a98-8da5-90c3e41d1673" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-0e50bbb0-1736-4a98-8da5-90c3e41d1673" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b86032-a85f-445d-8a10-11c1942be0be]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d37c0a4-05f1-44dc-abd7-795431b27bc2 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-84779f0e-866f-44c9-990a-5d8710b0c27f-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:11 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 Nov 02 11:00:11 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:11 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673 Nov 02 11:00:11 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:11 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0e50bbb0-1736-4a98-8da5-90c3e41d1673" returned: 0 in 0.300s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-0e50bbb0-1736-4a98-8da5-90c3e41d1673" released by "delete_volume" :: held 0.792s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['0435d9a9-b525-4c3c-8cd6-b7ec04a4fd13', 'a3d2a28e-7e2f-4540-987a-8c3219f2554b', '47c8eea1-87a0-4cce-8221-6a77c6503f3d', '91bbd07d-d946-4650-bcb3-66d8708b183b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:12 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb04b7-90a6-4b09-81c9-e7bd1eef1ace]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c438f4e1-e051-452b-baa0-dc7de76f1df6 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-0e50bbb0-1736-4a98-8da5-90c3e41d1673-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:12 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 Nov 02 11:00:12 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:12 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" returned: 0 in 0.464s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:12 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769 Nov 02 11:00:12 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769" released by "delete_volume" :: held 0.799s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=63,cinder:UPDATE=74,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['7ff4cc42-9df2-4a9b-8c95-b948bb0b1263', '656af9d5-9d2c-4556-9eb2-f9a09d67a748', 'c5e1c291-3db9-4a76-9c57-a8c198636594', '681cd397-acd9-4248-944d-cdff5d243f3a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:13 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-2a79d789-b0fd-4877-acc1-3978ff06b1ac-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-2a79d789-b0fd-4877-acc1-3978ff06b1ac-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=80,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-2a79d789-b0fd-4877-acc1-3978ff06b1ac" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-2a79d789-b0fd-4877-acc1-3978ff06b1ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a121206d-8cd3-4c5f-acac-650cdde6c621]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:13 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b9e41359-5cc7-477e-b53a-19fa19b1e736 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-d4d2760b-4cf8-4012-af2f-e7b7d5b6a769-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:13 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac Nov 02 11:00:13 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:13 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac Nov 02 11:00:14 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2a79d789-b0fd-4877-acc1-3978ff06b1ac" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-2a79d789-b0fd-4877-acc1-3978ff06b1ac" released by "delete_volume" :: held 0.708s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['bfc56ea6-38f5-463e-8e4f-8a924c7c674b', 'f597dfd7-8720-4558-8996-f9bdd9c6bcee', '0d452e0a-6814-44e5-9b17-8ca54164ae61', 'e5a7dd31-1ba3-4758-98ee-a817836ec725'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:14 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:14 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:14 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-545bedb2-43c1-4e37-8f06-21a9da96705b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f100bb16-52b6-4bbf-be00-cde7b0a87882 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-2a79d789-b0fd-4877-acc1-3978ff06b1ac-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-545bedb2-43c1-4e37-8f06-21a9da96705b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-545bedb2-43c1-4e37-8f06-21a9da96705b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-545bedb2-43c1-4e37-8f06-21a9da96705b" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[426181b0-349b-4103-a25e-83a10cc2ec09]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b Nov 02 11:00:15 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b Nov 02 11:00:15 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:15 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-545bedb2-43c1-4e37-8f06-21a9da96705b" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-545bedb2-43c1-4e37-8f06-21a9da96705b" released by "delete_volume" :: held 0.807s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['beee544e-b77a-4e5c-9058-33db3d8a60d0', 'ace65cb0-55ae-4c91-8a63-465f85ec2808', 'b234c8e5-ccf1-477f-b918-91eb1c1d0a99', '96e277d0-5fae-4e39-8be3-380ccd81ef60'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:15 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:15 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleting offline snapshot 61e3fefc-2a9d-4b56-80e6-bf9c4d44151e of volume 1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] snapshot_file for this snap is: volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3e4e3-f6b8-4eae-a367-50efc810511c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:16 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.439s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:16 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e Nov 02 11:00:16 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bde0de39-0079-4653-8868-fc498222c95e tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-545bedb2-43c1-4e37-8f06-21a9da96705b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:16 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" returned: 0 in 0.702s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e38efbb-2fda-4e65-83e5-c83f60380953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafbc785-dcae-4d04-b89e-54b585370155]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 Nov 02 11:00:17 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:17 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e Nov 02 11:00:17 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ede05490-cc3b-402f-868f-48c086de1110 req-1aded8a0-9309-419c-83b0-bbf17bb8a4d5 tempest-TestShelveInstance-1719968652 None] Terminate volume connection completed successfully. Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ede05490-cc3b-402f-868f-48c086de1110 req-1aded8a0-9309-419c-83b0-bbf17bb8a4d5 tempest-TestShelveInstance-1719968652 None] Deleting attachment affd00a8-79bd-4039-994f-16ece928a231. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Acquiring lock "cinder-07c6eb87-4927-46e3-b623-016200dfb74f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "cinder-07c6eb87-4927-46e3-b623-016200dfb74f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Acquiring lock "cinder-quobyte-07c6eb87-4927-46e3-b623-016200dfb74f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "cinder-quobyte-07c6eb87-4927-46e3-b623-016200dfb74f" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[071d0862-a58b-4063-8acd-4f04461e1522]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" returned: 0 in 0.507s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:17 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e Nov 02 11:00:17 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:18 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f Nov 02 11:00:18 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:18 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953.61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e" released by "_delete_snapshot" :: held 2.183s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" released by "delete_snapshot" :: held 2.214s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:18 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f" returned: 0 in 0.527s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['8d694aab-acfe-4788-80a9-9ba92c5ae175', '82ce968c-327d-4107-8c91-26baea8129c4', '51531ecf-07ee-405a-98c6-43eeda045b84', '820491ec-2e9f-417a-a00e-92a0260505bd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:18 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f Nov 02 11:00:18 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Delete snapshot completed successfully. Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e319491c-64ec-4447-8b0f-a0210f6a9d6d tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-61e3fefc-2a9d-4b56-80e6-bf9c4d44151e-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:18 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-07c6eb87-4927-46e3-b623-016200dfb74f" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "cinder-quobyte-07c6eb87-4927-46e3-b623-016200dfb74f" released by "delete_volume" :: held 0.921s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:18 devstack cinder-volume[86783]: DEBUG cinder.quota [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Created reservations ['30e87acd-b297-4b03-806c-04e1dfbafddf', 'ab4a7c79-39ae-4be3-954d-c1a62fc6fe73', '4af7f7fb-377c-480f-afbb-0df1528684fc', '82731725-959a-4eb2-945e-c2ad69c7f62f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:19 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:19 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-1e38efbb-2fda-4e65-83e5-c83f60380953-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-1e38efbb-2fda-4e65-83e5-c83f60380953-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:19 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.manager [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Deleted volume successfully. Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ede05490-cc3b-402f-868f-48c086de1110 req-adc90be1-f53b-44b6-b32a-ed1489c5bbce tempest-TestShelveInstance-1719968652 None] Lock "cinder-07c6eb87-4927-46e3-b623-016200dfb74f-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10dac0-420e-406e-bec5-4d58b0087f36]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:19 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 Nov 02 11:00:19 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:20 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:20 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953 Nov 02 11:00:20 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:20 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1e38efbb-2fda-4e65-83e5-c83f60380953" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-quobyte-1e38efbb-2fda-4e65-83e5-c83f60380953" released by "delete_volume" :: held 0.909s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Created reservations ['8d659210-d2e4-435a-927a-776d14f877f9', '1fb76fb6-fef2-480e-b9e6-1ece06cf75a6', 'b649b2c4-964a-4a35-a838-a3502b1e1a65', 'de0f843a-b665-4278-9c68-6b257514f859'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:20 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:20 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:20 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:20 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Deleted volume successfully. Nov 02 11:00:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb7657a9-a0ac-46be-aa1f-2018f4038ab7 tempest-CreateVolumesFromSnapshotTest-1727667415 None] Lock "cinder-1e38efbb-2fda-4e65-83e5-c83f60380953-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-348eb1de-16bf-432d-8be8-54c3a5cea53a req-59519c82-09e4-4e23-ac5f-00a5b979cdbf tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-348eb1de-16bf-432d-8be8-54c3a5cea53a req-59519c82-09e4-4e23-ac5f-00a5b979cdbf tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-348eb1de-16bf-432d-8be8-54c3a5cea53a req-59519c82-09e4-4e23-ac5f-00a5b979cdbf tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-348eb1de-16bf-432d-8be8-54c3a5cea53a req-59519c82-09e4-4e23-ac5f-00a5b979cdbf tempest-TestServerVolumeAttachmentScenario-1695856249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-8f2bfd65-b65b-4a24-a021-714960ef292b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c10e8600-e296-4e30-9627-46bf8428730e', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:00:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-348eb1de-16bf-432d-8be8-54c3a5cea53a req-59519c82-09e4-4e23-ac5f-00a5b979cdbf tempest-TestServerVolumeAttachmentScenario-1695856249 None] attachment_update completed successfully. Nov 02 11:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-0467d230-bb18-475c-887d-2f945d6bdc04 req-1474b580-ba32-4f44-a1bd-b7ef29754aa2 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-0467d230-bb18-475c-887d-2f945d6bdc04 req-1474b580-ba32-4f44-a1bd-b7ef29754aa2 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-0467d230-bb18-475c-887d-2f945d6bdc04 req-1474b580-ba32-4f44-a1bd-b7ef29754aa2 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-0467d230-bb18-475c-887d-2f945d6bdc04 req-1474b580-ba32-4f44-a1bd-b7ef29754aa2 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149', 'name': 'volume-69b4727b-58ab-4696-8f87-7e12c18c64c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3e28856-62ee-4e62-abcf-0c8b76dba67d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 11:00:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-0467d230-bb18-475c-887d-2f945d6bdc04 req-1474b580-ba32-4f44-a1bd-b7ef29754aa2 tempest-TestServerVolumeAttachmentScenario-1695856249 None] attachment_update completed successfully. Nov 02 11:00:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8b663357-9bc0-4fa3-ac25-833a53346dcb req-dadc0706-5fcf-41d6-8e4f-4f97543c597d tempest-TestServerVolumeAttachmentScenario-1695856249 None] Terminate volume connection completed successfully. Nov 02 11:00:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8b663357-9bc0-4fa3-ac25-833a53346dcb req-dadc0706-5fcf-41d6-8e4f-4f97543c597d tempest-TestServerVolumeAttachmentScenario-1695856249 None] Deleting attachment e3e28856-62ee-4e62-abcf-0c8b76dba67d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:00:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8bea54f5-30ca-4b62-8a72-3aba7a68445c req-9d3d98a3-f36f-43b1-8c75-fa8f8607484f tempest-TestServerVolumeAttachmentScenario-1695856249 None] Terminate volume connection completed successfully. Nov 02 11:00:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8bea54f5-30ca-4b62-8a72-3aba7a68445c req-9d3d98a3-f36f-43b1-8c75-fa8f8607484f tempest-TestServerVolumeAttachmentScenario-1695856249 None] Deleting attachment c10e8600-e296-4e30-9627-46bf8428730e. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Flow 'volume_create_manager' (79c6b789-4928-4429-b95d-5908cfafa843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da455f11-97a2-405c-98c0-4fffaa3b5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da455f11-97a2-405c-98c0-4fffaa3b5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307981e8-143d-4bd7-a94b-00c2e741407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eeb06075bc34b76893c6d3382a3248c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:43Z,use_quota=True,user_id='996d7441f82941afb18cdb7ae9bdcb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba17de47-e20b-43d2-9c07-fd8b1fc46818),volume_type_id=ba17de47-e20b-43d2-9c07-fd8b1fc46818)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25213021-e532-4889-8483-fffdcb7ff19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25213021-e532-4889-8483-fffdcb7ff19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c979ed6-5df8-4b33-bd35-ec6fd0f23350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:42 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c979ed6-5df8-4b33-bd35-ec6fd0f23350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '307981e8-143d-4bd7-a94b-00c2e741407b', 'volume_name': 'volume-307981e8-143d-4bd7-a94b-00c2e741407b', 'volume_size': 1, 'image_id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dc268eebbdcb4c898c0146f1db995b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeb06075bc34b76893c6d3382a3248c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c14710efdeae81d09b523bdd6ebf2f9a4d3cbe1b0305435775dd0dcab0d125e26bdeeff2cd884e7de8bcaf1e39925027b53cb95e99f80972771c136e66dcd481', 'id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'created_at': datetime.datetime(2026, 11, 2, 10, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09884a61-1869-44b9-99e2-408fb7c23ee1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a55a4c-df57-4e82-a87a-c26bd426f95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a55a4c-df57-4e82-a87a-c26bd426f95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f467c85-d60f-4ebb-83eb-713d46e28770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Volume 307981e8-143d-4bd7-a94b-00c2e741407b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-307981e8-143d-4bd7-a94b-00c2e741407b', 'volume_size': 1, 'image_id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dc268eebbdcb4c898c0146f1db995b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeb06075bc34b76893c6d3382a3248c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c14710efdeae81d09b523bdd6ebf2f9a4d3cbe1b0305435775dd0dcab0d125e26bdeeff2cd884e7de8bcaf1e39925027b53cb95e99f80972771c136e66dcd481', 'id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'created_at': datetime.datetime(2026, 11, 2, 10, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09884a61-1869-44b9-99e2-408fb7c23ee1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 11:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Trying to clone 307981e8-143d-4bd7-a94b-00c2e741407b from image 09884a61-1869-44b9-99e2-408fb7c23ee1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "cinder-69b4727b-58ab-4696-8f87-7e12c18c64c5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-69b4727b-58ab-4696-8f87-7e12c18c64c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 11:00:44 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "cinder-quobyte-69b4727b-58ab-4696-8f87-7e12c18c64c5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-quobyte-69b4727b-58ab-4696-8f87-7e12c18c64c5" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbe889c-0e96-4060-878d-e1fbcec9c2f4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa22549-f146-4e32-83e0-150292cac3bf]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:44 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 Nov 02 11:00:44 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:44 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:44 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:44 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:44 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:44 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5 Nov 02 11:00:44 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:44 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:44 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:45 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Temporary image 09884a61-1869-44b9-99e2-408fb7c23ee1 is fetched for user 996d7441f82941afb18cdb7ae9bdcb5b. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 11:00:45 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69b4727b-58ab-4696-8f87-7e12c18c64c5" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-quobyte-69b4727b-58ab-4696-8f87-7e12c18c64c5" released by "delete_volume" :: held 1.040s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570d06a-1cd5-40d8-8cdb-fdd2042254b8]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Created reservations ['56e4b9ca-553c-42a9-9699-49d372cd5701', 'bb705b07-44ef-412a-a2d6-7b010264a3f4', 'ebc64daa-5e0c-4f55-be90-3c92bedc1779', 'e6762201-43a4-423b-8f83-37bcd5087e98'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:45 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:45 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:45 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:45 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:45 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:45 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:45 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:45 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:45 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Deleted volume successfully. Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-94ae4721-9a4c-49b1-8ffc-ce86be17c2b5 tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-69b4727b-58ab-4696-8f87-7e12c18c64c5-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:46 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 1 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307981e8-143d-4bd7-a94b-00c2e741407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eeb06075bc34b76893c6d3382a3248c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:43Z,use_quota=True,user_id='996d7441f82941afb18cdb7ae9bdcb5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba17de47-e20b-43d2-9c07-fd8b1fc46818),volume_type_id=ba17de47-e20b-43d2-9c07-fd8b1fc46818)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Creating volume 307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:46 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1073741824 Nov 02 11:00:46 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "cinder-8f2bfd65-b65b-4a24-a021-714960ef292b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-8f2bfd65-b65b-4a24-a021-714960ef292b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "cinder-quobyte-8f2bfd65-b65b-4a24-a021-714960ef292b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-quobyte-8f2bfd65-b65b-4a24-a021-714960ef292b" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d3299-03be-4c0b-992b-aca452956b81]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:46 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b Nov 02 11:00:46 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1073741824" returned: 0 in 0.741s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:47 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b Nov 02 11:00:47 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b" returned: 0 in 0.542s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:47 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b Nov 02 11:00:47 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:47 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f2bfd65-b65b-4a24-a021-714960ef292b" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Attempting download of 09884a61-1869-44b9-99e2-408fb7c23ee1 ((None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}])) to volume 307981e8-143d-4bd7-a94b-00c2e741407b. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-quobyte-8f2bfd65-b65b-4a24-a021-714960ef292b" released by "delete_volume" :: held 0.919s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Flow 'volume_create_manager' (c662cbde-eae4-4295-95b2-8cec949af869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aceb3eb-e137-4acd-b52d-60434535d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7975ab43-9cb8-40ea-b9f5-0ada6f026765]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aceb3eb-e137-4acd-b52d-60434535d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1941934429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8d6d0d-d090-4a36-95df-2c19e6a39f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3d83c4f0964a2787ebd26aa41e605d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:47Z,use_quota=True,user_id='b2e9b6b91d8847479172886ca060389f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0035e302-491e-422f-b6c9-35be74839131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0035e302-491e-422f-b6c9-35be74839131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065cfffa-bf29-4d60-a499-00446ad211d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065cfffa-bf29-4d60-a499-00446ad211d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8d6d0d-d090-4a36-95df-2c19e6a39f50', 'volume_name': 'volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b834b0-7685-47bf-8755-0073feb3e166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b834b0-7685-47bf-8755-0073feb3e166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd13b3c-f8fe-4217-94a7-279ffbe0a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Volume bf8d6d0d-d090-4a36-95df-2c19e6a39f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50', 'volume_size': 1} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1941934429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8d6d0d-d090-4a36-95df-2c19e6a39f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3d83c4f0964a2787ebd26aa41e605d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:00:47Z,use_quota=True,user_id='b2e9b6b91d8847479172886ca060389f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Creating volume bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:00:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:47 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 1073741824 Nov 02 11:00:47 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Created reservations ['f8c14148-2102-4dca-9905-e0a843d5ec93', '3b2add37-e490-4af5-b077-fdb4e1c8a827', '7b626dd3-98c3-4001-96ac-27199cf6fa4f', '77ce5e65-50e4-4646-8f08-af1679a4e4e3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:47 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:47 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:47 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:47 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:48 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni Nov 02 11:00:48 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:48 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Deleted volume successfully. Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-716c5045-5902-4620-a681-7baeec6dec7a tempest-TestServerVolumeAttachmentScenario-1695856249 None] Lock "cinder-8f2bfd65-b65b-4a24-a021-714960ef292b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:48 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 1073741824" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:48 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:00:48 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:48 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni" returned: 1 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09884a61-1869-44b9-99e2-408fb7c23ee1_rexj3jni' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f991c48-01cf-4345-a4c2-1a040df6deea]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:48 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:48 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:48 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd13b3c-f8fe-4217-94a7-279ffbe0a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140bb3d5-06c8-4ff4-b480-12c0ed347797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Volume volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 (bf8d6d0d-d090-4a36-95df-2c19e6a39f50): created successfully Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140bb3d5-06c8-4ff4-b480-12c0ed347797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Flow 'volume_create_manager' (c662cbde-eae4-4295-95b2-8cec949af869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bcadec26-3e47-465c-aed7-3b04ed33f538 tempest-TestImageHashVerification-2131104691 None] Created volume successfully. Nov 02 11:00:48 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:48 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD Nov 02 11:00:48 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:49 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] 09884a61-1869-44b9-99e2-408fb7c23ee1 was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:49 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b Nov 02 11:00:49 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:49 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b" returned: 0 in 0.639s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09884a61-1869-44b9-99e2-408fb7c23ee1_hxoxnk5hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:00:49 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:00:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:49 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1G Nov 02 11:00:49 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:50 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b 1G" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Downloaded image 09884a61-1869-44b9-99e2-408fb7c23ee1 ((None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}])) to volume 307981e8-143d-4bd7-a94b-00c2e741407b successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Temporary image 09884a61-1869-44b9-99e2-408fb7c23ee1 for user 996d7441f82941afb18cdb7ae9bdcb5b is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Marking volume 307981e8-143d-4bd7-a94b-00c2e741407b as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Copying metadata from image 09884a61-1869-44b9-99e2-408fb7c23ee1 to 307981e8-143d-4bd7-a94b-00c2e741407b. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Creating volume glance metadata for volume 307981e8-143d-4bd7-a94b-00c2e741407b backed by image 09884a61-1869-44b9-99e2-408fb7c23ee1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1dc268eebbdcb4c898c0146f1db995b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f467c85-d60f-4ebb-83eb-713d46e28770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307981e8-143d-4bd7-a94b-00c2e741407b', 'volume_size': 1, 'image_id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09884a61-1869-44b9-99e2-408fb7c23ee1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dc268eebbdcb4c898c0146f1db995b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeb06075bc34b76893c6d3382a3248c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c14710efdeae81d09b523bdd6ebf2f9a4d3cbe1b0305435775dd0dcab0d125e26bdeeff2cd884e7de8bcaf1e39925027b53cb95e99f80972771c136e66dcd481', 'id': '09884a61-1869-44b9-99e2-408fb7c23ee1', 'created_at': datetime.datetime(2026, 11, 2, 10, 0, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 0, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09884a61-1869-44b9-99e2-408fb7c23ee1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35e2b2f-a7d2-45cb-b313-f008868f989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:00:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Volume volume-307981e8-143d-4bd7-a94b-00c2e741407b (307981e8-143d-4bd7-a94b-00c2e741407b): created successfully Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35e2b2f-a7d2-45cb-b313-f008868f989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Flow 'volume_create_manager' (79c6b789-4928-4429-b95d-5908cfafa843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:00:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-07d10b33-2942-4f43-96fa-5a57970d30ca tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Created volume successfully. Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6f5ce3-b51c-4270-80dd-985ae8b31418]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:50 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:00:50 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:51 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850c831-5664-412e-ab7a-3856b3d19bdc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:51 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:00:51 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Acquiring lock "cinder-307981e8-143d-4bd7-a94b-00c2e741407b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "cinder-307981e8-143d-4bd7-a94b-00c2e741407b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:51 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.511s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 /opt/stack/data/cinder/conversion/bf8d6d0d-d090-4a36-95df-2c19e6a39f50.temp_image.5958d56c-e0bf-4d07-ad60-ba525e9cf430tcsoqhwv.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Acquiring lock "cinder-quobyte-307981e8-143d-4bd7-a94b-00c2e741407b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "cinder-quobyte-307981e8-143d-4bd7-a94b-00c2e741407b" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:00:51 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 /opt/stack/data/cinder/conversion/bf8d6d0d-d090-4a36-95df-2c19e6a39f50.temp_image.5958d56c-e0bf-4d07-ad60-ba525e9cf430tcsoqhwv.img Nov 02 11:00:51 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a5e9f-dfd5-462e-bf9b-e9780dd7739b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:51 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b Nov 02 11:00:52 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:52 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b" returned: 0 in 0.671s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:52 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b Nov 02 11:00:52 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:53 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-307981e8-143d-4bd7-a94b-00c2e741407b" returned: 0 in 0.571s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "cinder-quobyte-307981e8-143d-4bd7-a94b-00c2e741407b" released by "delete_volume" :: held 1.357s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:00:53 devstack cinder-volume[86783]: WARNING cinder.quota [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:00:53 devstack cinder-volume[86783]: WARNING cinder.quota [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Created reservations ['6b7bcacf-b43d-4eba-a8a4-f44854b28e1a', '3b818c63-e38a-4c6d-b692-9552c18b202d', 'b6a649d2-c54a-4ee7-a9a2-153d9a3ed698', 'a04cce01-284f-438f-b393-bc9ccfd3c683'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:00:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:00:53 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:00:53 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:00:54 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Nov 02 11:00:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:00:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:00:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Deleted volume successfully. Nov 02 11:00:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bfc60f10-4a48-48aa-9a30-2073a11e35c2 tempest-VolumeAndVolumeTypeFromImageTest-1768410307 None] Lock "cinder-307981e8-143d-4bd7-a94b-00c2e741407b-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:00 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 /opt/stack/data/cinder/conversion/bf8d6d0d-d090-4a36-95df-2c19e6a39f50.temp_image.5958d56c-e0bf-4d07-ad60-ba525e9cf430tcsoqhwv.img" returned: 0 in 8.748s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[25711a27-55ff-4f92-92d0-7d9853f218cb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:00 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:01:00 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:01 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:01 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/conversion/bf8d6d0d-d090-4a36-95df-2c19e6a39f50.temp_image.5958d56c-e0bf-4d07-ad60-ba525e9cf430tcsoqhwv.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:01:01 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Converted 1024.00 MB image at 117.02 MB/s Nov 02 11:01:01 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] 5958d56c-e0bf-4d07-ad60-ba525e9cf430 was raw, no need to convert to raw {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:09 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:09 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:10 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.534s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:01:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:01:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:DELETE=7,cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=69 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=23,cinder:UPDATE=84,cinder:SELECT=65,cinder:DELETE=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (b80b770b-4f20-4e6d-bb2c-d4ce5b22fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc1dced-5a17-4a9e-acd5-98f23f94d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc1dced-5a17-4a9e-acd5-98f23f94d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-45987566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e11cf15-1488-4f53-80dd-6809c3df4412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:11Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198eaa6e-2ab9-4cfd-a6c4-5a05792ee193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198eaa6e-2ab9-4cfd-a6c4-5a05792ee193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f76cb-e550-485d-8c12-d8b664d379f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f76cb-e550-485d-8c12-d8b664d379f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e11cf15-1488-4f53-80dd-6809c3df4412', 'volume_name': 'volume-8e11cf15-1488-4f53-80dd-6809c3df4412', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e264e8f-66c0-4ae9-9262-044b7bea5678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e264e8f-66c0-4ae9-9262-044b7bea5678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d984a7-e2f2-4284-9a68-4decb56607af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Volume 8e11cf15-1488-4f53-80dd-6809c3df4412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e11cf15-1488-4f53-80dd-6809c3df4412', 'volume_size': 1} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Flow 'volume_create_manager' (1f00c136-d6f5-4a65-bf16-12db3f76d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549e239-6cdc-4217-9548-4a8a72e7c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549e239-6cdc-4217-9548-4a8a72e7c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3058518-99d6-49a3-9ce7-bf4f9d69ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ef8285c6574eabb98b86c198ae8e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='c3baccf0e01d4ccabdd8aa0dbefb7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae757ba-0413-41c4-9e23-b0bc0e3c7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae757ba-0413-41c4-9e23-b0bc0e3c7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebe1951-bd48-46ce-8622-7b3452877601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (84e5db16-36c4-45e3-9c23-833862feead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae947b9-aff4-4939-a709-144b6d17a587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae947b9-aff4-4939-a709-144b6d17a587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386999894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03887f1-6b6c-4c9b-b3a6-3ac03b22c424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7ae010-6fe9-486e-8771-5b44f74632f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7ae010-6fe9-486e-8771-5b44f74632f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da34058-dc88-460f-8b06-98455ea44d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da34058-dc88-460f-8b06-98455ea44d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03887f1-6b6c-4c9b-b3a6-3ac03b22c424', 'volume_name': 'volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea3cd54-0ba4-4193-956a-913424673086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea3cd54-0ba4-4193-956a-913424673086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb89004-bea9-4d2d-8252-fbe79907d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Volume f03887f1-6b6c-4c9b-b3a6-3ac03b22c424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424', 'volume_size': 1} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (e49cf17f-f615-443e-b8ac-aab2958a94b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76018e6-69eb-4fd6-b467-c70fa8d734c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76018e6-69eb-4fd6-b467-c70fa8d734c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262040695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdee3dd-98b4-410b-984d-ac87c0524629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdee3dd-98b4-410b-984d-ac87c0524629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff704c62-770e-4a38-a30b-3239a1d4e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff704c62-770e-4a38-a30b-3239a1d4e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7', 'volume_name': 'volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086f563-cfbd-4dbd-91c1-c0003810157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086f563-cfbd-4dbd-91c1-c0003810157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940227d-af07-40d9-b830-abe5fdaa8f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Volume 1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7', 'volume_size': 1} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebe1951-bd48-46ce-8622-7b3452877601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3058518-99d6-49a3-9ce7-bf4f9d69ec99', 'volume_name': 'volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99', 'volume_size': 1, 'image_id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4daa7dd78656ba78a1f526c0712953c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ef8285c6574eabb98b86c198ae8e75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7dd4fa273c05c9d2ea9de3f034d7a7cd25396295b1c19d5dc48cce6250a8fab554122b90b0e057809db9ff3a9d5201d2a7839050b28ef2b0f2986675f0b38852', 'id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'created_at': datetime.datetime(2026, 11, 2, 10, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 1, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d162b6c1-6295-4657-a9e1-0d8361d22f46/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c848103-3ac3-4124-b12e-70a43ebbea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c848103-3ac3-4124-b12e-70a43ebbea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3573a4-ffcb-4a87-916d-23951f7ec908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99', 'volume_size': 1, 'image_id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4daa7dd78656ba78a1f526c0712953c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ef8285c6574eabb98b86c198ae8e75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7dd4fa273c05c9d2ea9de3f034d7a7cd25396295b1c19d5dc48cce6250a8fab554122b90b0e057809db9ff3a9d5201d2a7839050b28ef2b0f2986675f0b38852', 'id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'created_at': datetime.datetime(2026, 11, 2, 10, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 1, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d162b6c1-6295-4657-a9e1-0d8361d22f46/file', 'properties': {}}, 'image_service': } Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Trying to clone b3058518-99d6-49a3-9ce7-bf4f9d69ec99 from image d162b6c1-6295-4657-a9e1-0d8361d22f46 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (e2d3625a-ba2e-48cc-b3b1-81b4291071e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9320de9-8b0e-4e08-af91-c02e3cd066cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9320de9-8b0e-4e08-af91-c02e3cd066cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-593286177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d92c6b-d9d0-4416-bc45-ae74bccf5787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:13Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d7dd1-5005-460d-9bfe-929e5313faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d7dd1-5005-460d-9bfe-929e5313faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c65a61-5e86-4081-8eb3-810639791385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c65a61-5e86-4081-8eb3-810639791385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d92c6b-d9d0-4416-bc45-ae74bccf5787', 'volume_name': 'volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bb1f7b-199a-4315-927e-4e0d5dd20e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bb1f7b-199a-4315-927e-4e0d5dd20e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc8a259-7d0e-4fcd-8921-c23a70f405d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Volume 43d92c6b-d9d0-4416-bc45-ae74bccf5787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787', 'volume_size': 1} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 11:01:13 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebfb9b-b9f2-4263-b197-c89dd1ebf84b]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:13 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:13 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (52001fa3-d7ce-4046-887a-2bd62482dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4a47f8-79d0-40bb-8d64-dde7ee28ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4a47f8-79d0-40bb-8d64-dde7ee28ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-838323797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4242ed8b-06af-4dcf-9943-ea780467ac31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:14Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bc4a0-5aae-4a7b-9562-f32b80f23ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109bc4a0-5aae-4a7b-9562-f32b80f23ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843ae9bf-cbe5-497d-9eaf-3297d9c5b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843ae9bf-cbe5-497d-9eaf-3297d9c5b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4242ed8b-06af-4dcf-9943-ea780467ac31', 'volume_name': 'volume-4242ed8b-06af-4dcf-9943-ea780467ac31', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a9ebdc-8e3f-43de-894a-f490831e84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a9ebdc-8e3f-43de-894a-f490831e84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19e8487-bae8-4f32-bed6-9c11377e8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Volume 4242ed8b-06af-4dcf-9943-ea780467ac31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4242ed8b-06af-4dcf-9943-ea780467ac31', 'volume_size': 1} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:14 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:14 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:14 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:14 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Temporary image d162b6c1-6295-4657-a9e1-0d8361d22f46 is fetched for user c3baccf0e01d4ccabdd8aa0dbefb7316. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc6981-3baa-4dda-970a-3c24af506b63]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:14 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:14 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:14 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:15 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:15 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:15 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Flow 'volume_create_manager' (1bbdc5e0-4ab3-4083-b573-0058b7b32f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c96aef6-5920-4729-b315-b2020ed1bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c96aef6-5920-4729-b315-b2020ed1bae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-210921116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f0901d-52b3-469e-b480-1d758f3ac9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89da62065248398c23220157a2b46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:21Z,use_quota=True,user_id='a60e30eff21043f1a70b481b931d734c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb48eb-e77b-458d-a244-942d8e3c7e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72eb48eb-e77b-458d-a244-942d8e3c7e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db40e252-2f2b-4778-b311-457c585d096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db40e252-2f2b-4778-b311-457c585d096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f0901d-52b3-469e-b480-1d758f3ac9bf', 'volume_name': 'volume-03f0901d-52b3-469e-b480-1d758f3ac9bf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b3a18b-8cf9-4864-89ac-d6632e940ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b3a18b-8cf9-4864-89ac-d6632e940ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406c361f-8a6b-4b2a-9def-377d78d2507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Volume 03f0901d-52b3-469e-b480-1d758f3ac9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f0901d-52b3-469e-b480-1d758f3ac9bf', 'volume_size': 1} Nov 02 11:01:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.363s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Uploaded volume to glance image-id: 5958d56c-e0bf-4d07-ad60-ba525e9cf430. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.378s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-45987566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e11cf15-1488-4f53-80dd-6809c3df4412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:11Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Creating volume 8e11cf15-1488-4f53-80dd-6809c3df4412 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:26 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 1073741824 Nov 02 11:01:26 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-716b0d95-bbbc-4ba7-a725-658c2da166dd tempest-TestImageHashVerification-2131104691 None] Copy volume to image completed successfully. Nov 02 11:01:26 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 1073741824" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:26 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 Nov 02 11:01:26 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:26 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.472s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386999894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03887f1-6b6c-4c9b-b3a6-3ac03b22c424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Creating volume f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d984a7-e2f2-4284-9a68-4decb56607af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e11cf15-1488-4f53-80dd-6809c3df4412', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:26 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 1073741824 Nov 02 11:01:26 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b67e4-39a1-4fdf-a173-ad85e30a7aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Volume volume-8e11cf15-1488-4f53-80dd-6809c3df4412 (8e11cf15-1488-4f53-80dd-6809c3df4412): created successfully Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777b67e4-39a1-4fdf-a173-ad85e30a7aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (b80b770b-4f20-4e6d-bb2c-d4ce5b22fd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d26f1b2a-2a4e-46c4-9273-8a966dfa0f49 tempest-CreateVolumesFromImageTest-1850255381 None] Created volume successfully. Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Acquiring lock "cinder-bf8d6d0d-d090-4a36-95df-2c19e6a39f50-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "cinder-bf8d6d0d-d090-4a36-95df-2c19e6a39f50-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Acquiring lock "cinder-quobyte-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "cinder-quobyte-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7e93e8-a7bb-479e-a090-4ccd3daa5e85]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:27 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:01:27 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:27 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 1073741824" returned: 0 in 0.457s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:27 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 Nov 02 11:01:27 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:27 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:27 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50 Nov 02 11:01:27 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:27 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.938s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262040695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Creating volume 1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:27 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 1073741824 Nov 02 11:01:27 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb89004-bea9-4d2d-8252-fbe79907d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e70fca-fef0-4744-a6dd-35540e75985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Volume volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 (f03887f1-6b6c-4c9b-b3a6-3ac03b22c424): created successfully Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e70fca-fef0-4744-a6dd-35540e75985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (84e5db16-36c4-45e3-9c23-833862feead4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ed28a025-9cf6-49de-99c8-9a023e3b6fad tempest-CreateVolumesFromImageTest-1850255381 None] Created volume successfully. Nov 02 11:01:27 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "cinder-quobyte-bf8d6d0d-d090-4a36-95df-2c19e6a39f50" released by "delete_volume" :: held 0.718s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Created reservations ['e92dc89c-a946-4bd7-95b0-06ac13268aed', 'e5813a17-7d70-427b-83c7-52f8556b4075', 'f89b2626-8ccb-41cc-bfd6-8f11547f47b8', '497221b1-d4fd-413e-b116-5b40dfd638ab'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:27 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:27 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:28 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 1073741824" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:28 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 Nov 02 11:01:28 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:28 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Deleted volume successfully. Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a0576a9a-bdbd-4e24-b827-ecc26565e84f tempest-TestImageHashVerification-2131104691 None] Lock "cinder-bf8d6d0d-d090-4a36-95df-2c19e6a39f50-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:28 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.312s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-593286177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d92c6b-d9d0-4416-bc45-ae74bccf5787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:13Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Creating volume 43d92c6b-d9d0-4416-bc45-ae74bccf5787 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940227d-af07-40d9-b830-abe5fdaa8f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6ff5bc-9913-4101-b3f0-d7324c438cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:28 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 1073741824 Nov 02 11:01:28 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Volume volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 (1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7): created successfully Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6ff5bc-9913-4101-b3f0-d7324c438cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (e49cf17f-f615-443e-b8ac-aab2958a94b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3eda7703-6e97-4992-bbed-546d925d7c39 tempest-CreateVolumesFromImageTest-1850255381 None] Created volume successfully. Nov 02 11:01:28 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 1073741824" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:28 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 Nov 02 11:01:28 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:29 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.147s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-838323797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4242ed8b-06af-4dcf-9943-ea780467ac31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ec85f45eb645838465b58e570fac33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:14Z,use_quota=True,user_id='b2c1b206751f4961a71ea37f07738680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Creating volume 4242ed8b-06af-4dcf-9943-ea780467ac31 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc8a259-7d0e-4fcd-8921-c23a70f405d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:29 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 1073741824 Nov 02 11:01:29 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3aedf-3a36-40f4-820c-49a07a8b81c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Volume volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 (43d92c6b-d9d0-4416-bc45-ae74bccf5787): created successfully Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b3aedf-3a36-40f4-820c-49a07a8b81c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (e2d3625a-ba2e-48cc-b3b1-81b4291071e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a92b82aa-e597-4da8-a6ee-91160518e2c6 tempest-CreateVolumesFromImageTest-1850255381 None] Created volume successfully. Nov 02 11:01:29 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 1073741824" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:29 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 Nov 02 11:01:29 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:29 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.555s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3058518-99d6-49a3-9ce7-bf4f9d69ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ef8285c6574eabb98b86c198ae8e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:12Z,use_quota=True,user_id='c3baccf0e01d4ccabdd8aa0dbefb7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Creating volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19e8487-bae8-4f32-bed6-9c11377e8d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4242ed8b-06af-4dcf-9943-ea780467ac31', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4387a3-f735-4f01-b25d-778c0f8c7364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:30 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1073741824 Nov 02 11:01:30 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Volume volume-4242ed8b-06af-4dcf-9943-ea780467ac31 (4242ed8b-06af-4dcf-9943-ea780467ac31): created successfully Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4387a3-f735-4f01-b25d-778c0f8c7364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Flow 'volume_create_manager' (52001fa3-d7ce-4046-887a-2bd62482dc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfce2a79-55f7-4eb3-bf86-64d87801edaa tempest-CreateVolumesFromImageTest-1850255381 None] Created volume successfully. Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-4242ed8b-06af-4dcf-9943-ea780467ac31-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-4242ed8b-06af-4dcf-9943-ea780467ac31-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-quobyte-4242ed8b-06af-4dcf-9943-ea780467ac31" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-4242ed8b-06af-4dcf-9943-ea780467ac31" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[697ab0d2-89c7-4e96-b9aa-a32636a05e3e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:30 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 Nov 02 11:01:30 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:30 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1073741824" returned: 0 in 0.550s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:30 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 Nov 02 11:01:30 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:30 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31" returned: 0 in 0.456s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:30 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31 Nov 02 11:01:30 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:30 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.414s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-210921116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f0901d-52b3-469e-b480-1d758f3ac9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89da62065248398c23220157a2b46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:21Z,use_quota=True,user_id='a60e30eff21043f1a70b481b931d734c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Creating volume 03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:30 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf 1073741824 Nov 02 11:01:30 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Attempting download of d162b6c1-6295-4657-a9e1-0d8361d22f46 ((None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}])) to volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 11:01:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b9f38-8694-4aaa-a862-b4885507e99c]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:31 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4242ed8b-06af-4dcf-9943-ea780467ac31" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-4242ed8b-06af-4dcf-9943-ea780467ac31" released by "delete_volume" :: held 0.788s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:31 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8 Nov 02 11:01:31 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Created reservations ['3924ac54-18e3-4fdc-93f3-80e066cec06c', 'ccc09d66-f612-45c2-880a-a9f3bd48daed', '483638e5-03c9-4e87-bd02-cf9a866ffdb7', '2d109ec2-7fda-466d-b9ae-76a5947c706b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:31 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:31 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-43d92c6b-d9d0-4416-bc45-ae74bccf5787-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:31 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf 1073741824" returned: 0 in 0.532s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:31 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-43d92c6b-d9d0-4416-bc45-ae74bccf5787-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:31 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:31 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-quobyte-43d92c6b-d9d0-4416-bc45-ae74bccf5787" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:31 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-43d92c6b-d9d0-4416-bc45-ae74bccf5787" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Deleted volume successfully. Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa6e33f-64f9-40e8-b6bf-9c3cc9337496]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:31 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8 Nov 02 11:01:31 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-13113a3a-3170-4786-b958-8abea18c9272 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-4242ed8b-06af-4dcf-9943-ea780467ac31-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:31 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 Nov 02 11:01:31 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:31 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:32 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8" returned: 1 in 0.538s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d162b6c1-6295-4657-a9e1-0d8361d22f46_bke4b3b8' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a02f0-0cfa-4254-aee2-4e129c7e5bc7]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406c361f-8a6b-4b2a-9def-377d78d2507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f0901d-52b3-469e-b480-1d758f3ac9bf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5766db5f-dc15-493c-8de5-64ebb22f7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Volume volume-03f0901d-52b3-469e-b480-1d758f3ac9bf (03f0901d-52b3-469e-b480-1d758f3ac9bf): created successfully Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5766db5f-dc15-493c-8de5-64ebb22f7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Flow 'volume_create_manager' (1bbdc5e0-4ab3-4083-b573-0058b7b32f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4e3b7a54-87fa-4e97-836f-c3ca33158417 tempest-SnapshotDependencyTests-2031924441 None] Created volume successfully. Nov 02 11:01:32 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787" returned: 0 in 0.513s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:32 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:32 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:32 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787 Nov 02 11:01:32 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:32 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:32 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-43d92c6b-d9d0-4416-bc45-ae74bccf5787" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-43d92c6b-d9d0-4416-bc45-ae74bccf5787" released by "delete_volume" :: held 0.867s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:32 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Created reservations ['e7082f22-ddb9-4a0b-9f50-0884b1ab893e', '0cc00b1c-cf44-4888-b539-7a646f4d90ff', '3b9d8d72-330c-4fcf-9660-a8abc275a4cb', '093612c0-bb02-4ca8-ba86-3f023e695423'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:32 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:32 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:32 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:32 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] d162b6c1-6295-4657-a9e1-0d8361d22f46 was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:32 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 Nov 02 11:01:32 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:32 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Deleted volume successfully. Nov 02 11:01:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3f326a28-e624-4d87-8e81-468b997bf29c tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-43d92c6b-d9d0-4416-bc45-ae74bccf5787-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Creating offline snapshot 9093f0d8-a705-4b19-a7b6-02f8897c85d3 of volume 03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:01:33 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" returned: 0 in 0.572s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d162b6c1-6295-4657-a9e1-0d8361d22f46_rqnero9sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:01:33 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a68f5-1abd-4604-8a88-c919f6d53ddd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:33 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1G Nov 02 11:01:33 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:33 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:33 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-quobyte-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:33 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 1G" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Downloaded image d162b6c1-6295-4657-a9e1-0d8361d22f46 ((None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}])) to volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Temporary image d162b6c1-6295-4657-a9e1-0d8361d22f46 for user c3baccf0e01d4ccabdd8aa0dbefb7316 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Marking volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Copying metadata from image d162b6c1-6295-4657-a9e1-0d8361d22f46 to b3058518-99d6-49a3-9ce7-bf4f9d69ec99. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Creating volume glance metadata for volume b3058518-99d6-49a3-9ce7-bf4f9d69ec99 backed by image d162b6c1-6295-4657-a9e1-0d8361d22f46 with: {'image_id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c4daa7dd78656ba78a1f526c0712953c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ddaf23-2995-4fa2-a3e1-c34e1cf29356]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:33 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:33 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 1G Nov 02 11:01:33 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3573a4-ffcb-4a87-916d-23951f7ec908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99', 'volume_size': 1, 'image_id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d162b6c1-6295-4657-a9e1-0d8361d22f46', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4daa7dd78656ba78a1f526c0712953c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ef8285c6574eabb98b86c198ae8e75', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7dd4fa273c05c9d2ea9de3f034d7a7cd25396295b1c19d5dc48cce6250a8fab554122b90b0e057809db9ff3a9d5201d2a7839050b28ef2b0f2986675f0b38852', 'id': 'd162b6c1-6295-4657-a9e1-0d8361d22f46', 'created_at': datetime.datetime(2026, 11, 2, 10, 1, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 1, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d162b6c1-6295-4657-a9e1-0d8361d22f46/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a799979e-99dc-4de2-8c94-2062e36fb0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Volume volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 (b3058518-99d6-49a3-9ce7-bf4f9d69ec99): created successfully Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a799979e-99dc-4de2-8c94-2062e36fb0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Flow 'volume_create_manager' (1f00c136-d6f5-4a65-bf16-12db3f76d57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:34 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 Nov 02 11:01:34 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-690d9347-3bd8-4f98-be0b-61c6a0bb9359 tempest-VolumeImageDependencyTests-2000774164 None] Created volume successfully. Nov 02 11:01:34 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" returned: 0 in 0.403s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:34 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7 Nov 02 11:01:34 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:34 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 1G" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f0901d-52b3-469e-b480-1d758f3ac9bf -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:34 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f0901d-52b3-469e-b480-1d758f3ac9bf -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:34 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:34 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7" released by "delete_volume" :: held 0.775s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Created reservations ['02738341-81ca-402c-ba57-63ba87da2853', '407d8363-4ee1-41f2-8458-3086a86b80db', 'ef91f135-7652-42bd-9b8c-5ce5c39ed0bb', '43cd8b95-5b4b-4987-8c5b-927783c607eb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:34 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f0901d-52b3-469e-b480-1d758f3ac9bf -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:34 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 is being set with open permissions: ugo+rw Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:34 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:34 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:34 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:34 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Acquiring lock "cinder-b3058518-99d6-49a3-9ce7-bf4f9d69ec99-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "cinder-b3058518-99d6-49a3-9ce7-bf4f9d69ec99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Acquiring lock "cinder-quobyte-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "cinder-quobyte-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[584546d2-1d24-45dc-adab-8fd989eb2304]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-quobyte-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:35 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:35 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709a62f-9dad-4c14-9177-700b11496566]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Deleted volume successfully. Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 Nov 02 11:01:35 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15530223-49c4-4469-8d28-dede2ff8528d tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-1a8f9e2a-7f59-4b64-a784-52b9f10a3dc7-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:35 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info Nov 02 11:01:35 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 Nov 02 11:01:35 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" returned: 0 in 0.525s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info is being set with open permissions: ugo+rw Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99 Nov 02 11:01:35 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:35 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info Nov 02 11:01:35 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424 Nov 02 11:01:35 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:35 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "cinder-quobyte-b3058518-99d6-49a3-9ce7-bf4f9d69ec99" released by "delete_volume" :: held 0.921s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.info" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424" released by "delete_volume" :: held 0.795s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-597e7f36-2489-4ed2-a330-571116abbf9d tempest-SnapshotDependencyTests-2031924441 None] Create snapshot completed successfully Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Created reservations ['9c35568c-f4d7-44ae-b029-2839ac83da01', 'e73a792e-835c-48f4-af0d-4b786fbadb71', '22e3ef9f-6ca7-4493-af9e-8034620ab3af', '232b80b6-940f-49ac-b776-6beb163b7b0b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Created reservations ['df214e0d-595b-4884-826c-a7e43d921bfa', '2718a47e-1d24-4b98-8ca3-f1ee70c63399', 'e7f05fb7-86f0-40a6-9404-c6c30e625e79', '8d4d3419-8d5d-43fe-b5d6-fa136fe2f7fa'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:36 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:36 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:36 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:36 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:36 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Deleted volume successfully. Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ddf1fa3f-fe76-4269-a5c5-57a48d0e7312 tempest-VolumeImageDependencyTests-2000774164 None] Lock "cinder-b3058518-99d6-49a3-9ce7-bf4f9d69ec99-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:36 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Deleted volume successfully. Nov 02 11:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-298c4ffe-2611-4cc3-bc83-fec6e5741d49 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-f03887f1-6b6c-4c9b-b3a6-3ac03b22c424-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-8e11cf15-1488-4f53-80dd-6809c3df4412-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Flow 'volume_create_manager' (2f4ffdda-75d5-40ae-8e3f-99f4c98987f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59167ec-c794-420d-96ab-c320ab36b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-8e11cf15-1488-4f53-80dd-6809c3df4412-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59167ec-c794-420d-96ab-c320ab36b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f1e75f-d39a-4e9e-a43e-517018c1b5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa89da62065248398c23220157a2b46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9093f0d8-a705-4b19-a7b6-02f8897c85d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:37Z,use_quota=True,user_id='a60e30eff21043f1a70b481b931d734c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a21873f-2510-4219-9b98-446d883eb4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a21873f-2510-4219-9b98-446d883eb4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbea84a-56ff-4088-b3c4-b7d3f6abc9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbea84a-56ff-4088-b3c4-b7d3f6abc9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5f1e75f-d39a-4e9e-a43e-517018c1b5d5', 'volume_name': 'volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5', 'volume_size': 1, 'snapshot_id': '9093f0d8-a705-4b19-a7b6-02f8897c85d3'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e95344-f08c-4774-bc11-2bda5c082ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e95344-f08c-4774-bc11-2bda5c082ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fb5cd4-b4a1-4d7b-a49a-bba8cec9acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Volume c5f1e75f-d39a-4e9e-a43e-517018c1b5d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5', 'volume_size': 1, 'snapshot_id': '9093f0d8-a705-4b19-a7b6-02f8897c85d3'} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "cinder-quobyte-8e11cf15-1488-4f53-80dd-6809c3df4412" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-8e11cf15-1488-4f53-80dd-6809c3df4412" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Creating volume c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 from snapshot 9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5820c880-e9e2-4387-b172-bee1200548ce]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] snapshot: 9093f0d8-a705-4b19-a7b6-02f8897c85d3, volume: c5f1e75f-d39a-4e9e-a43e-517018c1b5d5, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[91525df8-702f-4bd2-899c-3af5f6bad3f1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:37 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 Nov 02 11:01:37 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:37 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:37 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:38 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.472s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03f0901d-52b3-469e-b480-1d758f3ac9bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:01:38 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412" returned: 0 in 0.577s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1d645-ca3f-4776-ad2d-7ec6fdfc65cb]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:38 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412 Nov 02 11:01:38 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:38 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:38 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:38 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8e11cf15-1488-4f53-80dd-6809c3df4412" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-quobyte-8e11cf15-1488-4f53-80dd-6809c3df4412" released by "delete_volume" :: held 0.936s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Created reservations ['1069f78d-1647-4761-9245-a77f861d35a1', '780d86eb-b5f9-413c-986a-6703389fd66e', '280554e2-100f-403a-be9f-4e7fef24b030', '3b651613-46bb-42ea-8c0b-f39e5a16f302'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:38 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:38 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:38 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:38 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 Nov 02 11:01:38 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:38 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Deleted volume successfully. Nov 02 11:01:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea6c35e5-5537-4554-bda4-c1453596b727 tempest-CreateVolumesFromImageTest-1850255381 None] Lock "cinder-8e11cf15-1488-4f53-80dd-6809c3df4412-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Flow 'volume_create_manager' (628900bc-dcf3-432f-b1dd-329883921a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3843bd1-73b9-4016-a431-622a52c454fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3843bd1-73b9-4016-a431-622a52c454fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1705427298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe08e4fd-556c-416a-b8c3-8427fe40ae0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ced6aeff7540bfa2dea2770e9bb06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:44Z,use_quota=True,user_id='e69d02bbac9d46fda968903db4e14675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb656c0d-1948-45fc-8b1b-a86a539fdc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb656c0d-1948-45fc-8b1b-a86a539fdc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24ac472-c85d-4369-88be-441cd62f0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24ac472-c85d-4369-88be-441cd62f0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe08e4fd-556c-416a-b8c3-8427fe40ae0c', 'volume_name': 'volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61947b8a-61a4-4885-b7df-44f356f3d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61947b8a-61a4-4885-b7df-44f356f3d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d42239-2eb3-4829-8299-e85eff575474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Volume fe08e4fd-556c-416a-b8c3-8427fe40ae0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c', 'volume_size': 1} Nov 02 11:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (527f55a0-d3d8-4708-a049-b7871737e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d1136-15d1-4f8d-be74-078c51817b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d1136-15d1-4f8d-be74-078c51817b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259437262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:46Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1000a6ee-2e21-4514-9f96-2efa97d41bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1000a6ee-2e21-4514-9f96-2efa97d41bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a28c0d-b893-4756-b907-216f683beb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a28c0d-b893-4756-b907-216f683beb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8', 'volume_name': 'volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcb7b9e-9ec8-4ccd-91cf-71a1792a4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcb7b9e-9ec8-4ccd-91cf-71a1792a4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf24e18-6c70-4141-8b8f-a1c3d58476d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume 8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8', 'volume_size': 1} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:46 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" returned: 0 in 7.839s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:01:46 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Converted 1024.00 MB image at 130.61 MB/s Nov 02 11:01:46 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 is being set with open permissions: ugo+rw Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:46 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 Nov 02 11:01:46 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:46 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" released by "_copy_volume_from_snapshot" :: held 9.268s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" released by "_create_volume_from_snapshot" :: held 9.342s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.393s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.429s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1705427298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe08e4fd-556c-416a-b8c3-8427fe40ae0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ced6aeff7540bfa2dea2770e9bb06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:44Z,use_quota=True,user_id='e69d02bbac9d46fda968903db4e14675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Creating volume fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:46 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c 1073741824 Nov 02 11:01:46 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fb5cd4-b4a1-4d7b-a49a-bba8cec9acbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5', 'volume_size': 1, 'snapshot_id': '9093f0d8-a705-4b19-a7b6-02f8897c85d3'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3735ea08-3c2d-47b2-b116-40229304a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Volume volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 (c5f1e75f-d39a-4e9e-a43e-517018c1b5d5): created successfully Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3735ea08-3c2d-47b2-b116-40229304a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Flow 'volume_create_manager' (2f4ffdda-75d5-40ae-8e3f-99f4c98987f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-33498469-587d-431d-a690-2df66eefaeee tempest-SnapshotDependencyTests-2031924441 None] Created volume successfully. Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-9093f0d8-a705-4b19-a7b6-02f8897c85d3-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:47 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-9093f0d8-a705-4b19-a7b6-02f8897c85d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c 1073741824" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Deleting offline snapshot 9093f0d8-a705-4b19-a7b6-02f8897c85d3 of volume 03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] snapshot_file for this snap is: volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3635c-529b-4f56-abee-cfcd501dc258]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:47 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:01:47 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:47 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:47 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:47 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259437262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:46Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume 8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:47 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 1073741824 Nov 02 11:01:47 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d42239-2eb3-4829-8299-e85eff575474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd59934-3663-494b-8f2e-b1c4ceda0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Volume volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c (fe08e4fd-556c-416a-b8c3-8427fe40ae0c): created successfully Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd59934-3663-494b-8f2e-b1c4ceda0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Flow 'volume_create_manager' (628900bc-dcf3-432f-b1dd-329883921a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-23664259-39a2-46c1-9e70-cb00e7759a47 tempest-VolumeDependencyTests-1516442449 None] Created volume successfully. Nov 02 11:01:47 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03f0901d-52b3-469e-b480-1d758f3ac9bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb048101-2cf1-422b-98e7-4a9f4341e0be]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:47 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:47 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:48 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 1073741824" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:48 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 Nov 02 11:01:48 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:48 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.563s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:48 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:48 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:48 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf24e18-6c70-4141-8b8f-a1c3d58476d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3d426d-5307-4732-afac-b374b25afa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 (8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8): created successfully Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3d426d-5307-4732-afac-b374b25afa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (527f55a0-d3d8-4708-a049-b7871737e99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c302abda-75c5-498f-8750-2a425c0fa8be tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Creating offline snapshot cb2f7e27-86c7-4eeb-bf36-c6839d13e049 of volume fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb4937c-5b37-4919-9644-b67460af4b16]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:48 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:48 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3 Nov 02 11:01:48 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:48 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:01:48 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:49 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf.9093f0d8-a705-4b19-a7b6-02f8897c85d3" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:49 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-9093f0d8-a705-4b19-a7b6-02f8897c85d3" released by "_delete_snapshot" :: held 1.814s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" released by "delete_snapshot" :: held 1.870s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:49 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 1G Nov 02 11:01:49 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (fe78c9b3-bb94-4425-b310-bd6e810e8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7d4b10-dd30-4f22-a1df-298aac0afc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7d4b10-dd30-4f22-a1df-298aac0afc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507528629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a505b9-0a1f-4f5c-a744-4484395605e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:49Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d21610f-b4ad-4cf2-8a93-864902e8f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d21610f-b4ad-4cf2-8a93-864902e8f27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f550deb5-7416-4d7f-bddf-5b4b899be9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f550deb5-7416-4d7f-bddf-5b4b899be9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a505b9-0a1f-4f5c-a744-4484395605e0', 'volume_name': 'volume-65a505b9-0a1f-4f5c-a744-4484395605e0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5375481-91a1-4e19-946e-f69ad8aae34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5375481-91a1-4e19-946e-f69ad8aae34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1715340-2606-4464-810c-933043595e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume 65a505b9-0a1f-4f5c-a744-4484395605e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a505b9-0a1f-4f5c-a744-4484395605e0', 'volume_size': 1} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Created reservations ['3fd7a298-e5db-4d92-8853-61c838f0d1cf', 'c53dd54d-cc0a-4800-ac31-c5b7ea3e0676', 'c3125aa7-5aeb-42b3-8b3d-0c1541867985', 'b47cd36c-1fee-4b9f-a4d1-c998505bf50a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Delete snapshot completed successfully. Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-50ab244f-2262-4b63-8f70-ff8d9681d1ce tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-9093f0d8-a705-4b19-a7b6-02f8897c85d3-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (272976c7-bfa1-4b68-a795-61ea704dca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29f3161-a2c4-4b50-bd1c-a4056af17a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29f3161-a2c4-4b50-bd1c-a4056af17a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774949844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6128f1-1b84-4dc0-b852-242c0fde1368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2806f888-8968-4d3d-9c85-4e8e8df94088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2806f888-8968-4d3d-9c85-4e8e8df94088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d090648e-a339-4c4e-bc13-fab5dbeb2e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d090648e-a339-4c4e-bc13-fab5dbeb2e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6128f1-1b84-4dc0-b852-242c0fde1368', 'volume_name': 'volume-bb6128f1-1b84-4dc0-b852-242c0fde1368', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058e01a3-59f4-4a3a-b9fc-a699ebcf334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058e01a3-59f4-4a3a-b9fc-a699ebcf334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb29af-66ff-4fad-874b-2b1bcac9c7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume bb6128f1-1b84-4dc0-b852-242c0fde1368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6128f1-1b84-4dc0-b852-242c0fde1368', 'volume_size': 1} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 1G" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:49 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:01:49 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (730b8b43-3a35-4906-93f5-609f2ffa3afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6889233-a042-48e5-84bc-ebff5d8300b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:50 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 is being set with open permissions: ugo+rw Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6889233-a042-48e5-84bc-ebff5d8300b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363799993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2eea3d-2fdd-48ef-bac2-8fec0abd8346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:01:50 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44def46d-f95f-4fe9-8886-3f66f049634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44def46d-f95f-4fe9-8886-3f66f049634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ca82a7-2463-4ebe-a16e-2b5d40219c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ca82a7-2463-4ebe-a16e-2b5d40219c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2eea3d-2fdd-48ef-bac2-8fec0abd8346', 'volume_name': 'volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f7095-ba1e-4302-a724-19d9ad698542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f7095-ba1e-4302-a724-19d9ad698542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc542977-ce85-4e8f-b225-aaf0f48846b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume fd2eea3d-2fdd-48ef-bac2-8fec0abd8346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346', 'volume_size': 1} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:50 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (0a04f170-9f0e-4ac2-8c9f-a5a325cbd445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4023fa9-6b4b-46ea-b106-ecc18a1fbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4023fa9-6b4b-46ea-b106-ecc18a1fbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204802277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a33cb-f375-4452-b885-56dbe11795aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258beef4-12dc-4fbb-835e-080137b11d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258beef4-12dc-4fbb-835e-080137b11d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10b66b0-a450-42f5-a334-026de6582a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10b66b0-a450-42f5-a334-026de6582a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2a33cb-f375-4452-b885-56dbe11795aa', 'volume_name': 'volume-8b2a33cb-f375-4452-b885-56dbe11795aa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7cee3-860d-4a69-b4f1-842f9ed2deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d7cee3-860d-4a69-b4f1-842f9ed2deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d1a08c-2dc1-4a17-b4e6-bd25ab39dae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume 8b2a33cb-f375-4452-b885-56dbe11795aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2a33cb-f375-4452-b885-56dbe11795aa', 'volume_size': 1} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:50 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info Nov 02 11:01:50 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-03f0901d-52b3-469e-b480-1d758f3ac9bf-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-03f0901d-52b3-469e-b480-1d758f3ac9bf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2ebfd-3df7-491a-afd4-eb9983139dd7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:50 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:50 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info is being set with open permissions: ugo+rw Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:50 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info Nov 02 11:01:50 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (34f155f4-ea6f-410e-9161-d78def701bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce77be3-eea0-4f56-974b-7de9d84547f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce77be3-eea0-4f56-974b-7de9d84547f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063350285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245434c-371c-480f-a573-cf85d6bad132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:51Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:50 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0180b153-f174-41d1-b17d-af8613e004e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0180b153-f174-41d1-b17d-af8613e004e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0be8a7-27df-41bf-8aed-7a7470ccd016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0be8a7-27df-41bf-8aed-7a7470ccd016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4245434c-371c-480f-a573-cf85d6bad132', 'volume_name': 'volume-4245434c-371c-480f-a573-cf85d6bad132', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7031d616-a5bb-4a85-afdd-9156ae366998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7031d616-a5bb-4a85-afdd-9156ae366998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e40003-ff58-498c-b12f-f173c15f43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume 4245434c-371c-480f-a573-cf85d6bad132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4245434c-371c-480f-a573-cf85d6bad132', 'volume_size': 1} Nov 02 11:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:51 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.info" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1507528629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a505b9-0a1f-4f5c-a744-4484395605e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:49Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume 65a505b9-0a1f-4f5c-a744-4484395605e0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:51 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 1073741824 Nov 02 11:01:51 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:51 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-55f79fe1-16fb-4946-a9e2-11ba4502cf59 tempest-VolumeDependencyTests-1516442449 None] Create snapshot completed successfully Nov 02 11:01:51 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf Nov 02 11:01:51 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:51 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-03f0901d-52b3-469e-b480-1d758f3ac9bf" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-03f0901d-52b3-469e-b480-1d758f3ac9bf" released by "delete_volume" :: held 0.740s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Created reservations ['6f41d799-526e-4719-a259-6df5ac61cc95', '957da77c-7217-4998-83b9-688f5b0a3690', 'cf43f334-d972-465b-816e-1387a3fe25a1', '9ef45351-a418-46f7-b403-833750d2231f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:51 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:51 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:51 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 1073741824" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:51 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 Nov 02 11:01:51 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:51 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Deleted volume successfully. Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e59b9839-5e2e-4ed9-8014-b44f0c5c3a8e tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-03f0901d-52b3-469e-b480-1d758f3ac9bf-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:52 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-774949844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6128f1-1b84-4dc0-b852-242c0fde1368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume bb6128f1-1b84-4dc0-b852-242c0fde1368 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f2001f-51aa-47e4-8c60-f683f3acb1ab]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 1073741824 Nov 02 11:01:52 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1715340-2606-4464-810c-933043595e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a505b9-0a1f-4f5c-a744-4484395605e0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130143e7-51c3-4df9-a0ba-6831fc085853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-65a505b9-0a1f-4f5c-a744-4484395605e0 (65a505b9-0a1f-4f5c-a744-4484395605e0): created successfully Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130143e7-51c3-4df9-a0ba-6831fc085853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (fe78c9b3-bb94-4425-b310-bd6e810e8235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f82f4ee6-0906-4163-aefd-d725a19721e3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:52 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 Nov 02 11:01:52 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:52 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5 Nov 02 11:01:52 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Flow 'volume_create_manager' (548095e3-1807-4f1f-9479-d7e1b14b0401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cec91-bbbd-4a60-a5c5-a1ee141d2400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cec91-bbbd-4a60-a5c5-a1ee141d2400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1304216202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3edffd-ddbf-4eb7-9f3f-30327d1af993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ced6aeff7540bfa2dea2770e9bb06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb2f7e27-86c7-4eeb-bf36-c6839d13e049,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:52Z,use_quota=True,user_id='e69d02bbac9d46fda968903db4e14675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bb73bf-d116-42e9-9967-a31e80703bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bb73bf-d116-42e9-9967-a31e80703bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5553c84-5f55-4dcd-9255-19ca1d953bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5553c84-5f55-4dcd-9255-19ca1d953bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f3edffd-ddbf-4eb7-9f3f-30327d1af993', 'volume_name': 'volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993', 'volume_size': 1, 'snapshot_id': 'cb2f7e27-86c7-4eeb-bf36-c6839d13e049'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74aae907-6ebd-441d-a962-3a0fa6351314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74aae907-6ebd-441d-a962-3a0fa6351314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4f2e12-c4e5-44fe-b176-01831a0635af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Volume 9f3edffd-ddbf-4eb7-9f3f-30327d1af993: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993', 'volume_size': 1, 'snapshot_id': 'cb2f7e27-86c7-4eeb-bf36-c6839d13e049'} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 1073741824" returned: 0 in 0.581s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 Nov 02 11:01:52 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:52 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-quobyte-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5" released by "delete_volume" :: held 0.789s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Created reservations ['20a9b851-30c9-467e-9f52-1105d6b900ee', 'd9566822-a124-435e-bac7-565b35f3d557', 'be3cce20-a8da-43cd-8c21-a64e09392693', '83f7e695-8d7a-4e6c-b650-f46cdd85d554'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:52 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363799993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2eea3d-2fdd-48ef-bac2-8fec0abd8346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 1073741824 Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb29af-66ff-4fad-874b-2b1bcac9c7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6128f1-1b84-4dc0-b852-242c0fde1368', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:52 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ea2839-4fbe-4401-b284-3255cfba4785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 (bb6128f1-1b84-4dc0-b852-242c0fde1368): created successfully Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ea2839-4fbe-4401-b284-3255cfba4785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (272976c7-bfa1-4b68-a795-61ea704dca2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:53 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:53 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a14bd35e-427c-4dda-a060-0df1465e0676 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:53 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Deleted volume successfully. Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ef66195-a18a-4304-8004-918778ec5d23 tempest-SnapshotDependencyTests-2031924441 None] Lock "cinder-c5f1e75f-d39a-4e9e-a43e-517018c1b5d5-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:53 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 1073741824" returned: 0 in 0.513s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:53 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 Nov 02 11:01:53 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:53 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.282s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204802277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a33cb-f375-4452-b885-56dbe11795aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:50Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume 8b2a33cb-f375-4452-b885-56dbe11795aa {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:53 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa 1073741824 Nov 02 11:01:53 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc542977-ce85-4e8f-b225-aaf0f48846b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb10ff9-0c82-4b2f-a521-3726fdd41c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 (fd2eea3d-2fdd-48ef-bac2-8fec0abd8346): created successfully Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb10ff9-0c82-4b2f-a521-3726fdd41c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (730b8b43-3a35-4906-93f5-609f2ffa3afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02ea1bbd-01a8-46a1-b15c-f61f12167cd7 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:54 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa 1073741824" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:54 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa Nov 02 11:01:54 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:54 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.619s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1063350285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245434c-371c-480f-a573-cf85d6bad132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff01073e21f46959747615caf3ae06d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:01:51Z,use_quota=True,user_id='fc3375398a3746c4a1277603061f9cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Creating volume 4245434c-371c-480f-a573-cf85d6bad132 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:54 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 1073741824 Nov 02 11:01:54 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d1a08c-2dc1-4a17-b4e6-bd25ab39dae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2a33cb-f375-4452-b885-56dbe11795aa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226996f4-5f80-4fb6-9eca-60ffbb63ab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-8b2a33cb-f375-4452-b885-56dbe11795aa (8b2a33cb-f375-4452-b885-56dbe11795aa): created successfully Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226996f4-5f80-4fb6-9eca-60ffbb63ab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (0a04f170-9f0e-4ac2-8c9f-a5a325cbd445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-28dc33b2-1908-459e-a1d1-eb7f755fd6b9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:55 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 1073741824" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:55 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 Nov 02 11:01:55 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:55 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.711s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e40003-ff58-498c-b12f-f173c15f43c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4245434c-371c-480f-a573-cf85d6bad132', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d4b8e8-a9af-4556-8a6f-d4fea4a73298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Creating volume 9f3edffd-ddbf-4eb7-9f3f-30327d1af993 from snapshot cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Volume volume-4245434c-371c-480f-a573-cf85d6bad132 (4245434c-371c-480f-a573-cf85d6bad132): created successfully Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d4b8e8-a9af-4556-8a6f-d4fea4a73298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Flow 'volume_create_manager' (34f155f4-ea6f-410e-9161-d78def701bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] snapshot: cb2f7e27-86c7-4eeb-bf36-c6839d13e049, volume: 9f3edffd-ddbf-4eb7-9f3f-30327d1af993, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:01:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5870d1df-2fb0-4d05-aef0-ec6fc67df0d3 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created volume successfully. Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c579a-c828-40bc-a83c-de73fe844720]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:55 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:01:55 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:55 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[678d752b-c50a-4ad0-bf2e-627016f5dcc9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:55 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:01:55 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:56 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:56 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 Nov 02 11:01:56 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-4245434c-371c-480f-a573-cf85d6bad132-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-4245434c-371c-480f-a573-cf85d6bad132-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-4245434c-371c-480f-a573-cf85d6bad132" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-4245434c-371c-480f-a573-cf85d6bad132" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c04eec-b83f-47c4-80de-ad88eb0b5c2b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:56 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 Nov 02 11:01:56 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:57 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132" returned: 0 in 0.615s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:57 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132 Nov 02 11:01:57 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:57 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4245434c-371c-480f-a573-cf85d6bad132" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-4245434c-371c-480f-a573-cf85d6bad132" released by "delete_volume" :: held 1.201s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['dcf71337-fd20-4c50-b766-f22325224d48', 'a1b344fe-774b-43d7-bdec-49a3f14a6ef9', 'a2ac8007-4db7-4329-b195-f9eca2d51d72', 'bcffa35b-0800-4c44-affd-aec66a372441'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:57 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:01:57 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:58 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:01:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff4f9980-c9da-4d10-b882-8bf8919c0a3c tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-4245434c-371c-480f-a573-cf85d6bad132-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-8b2a33cb-f375-4452-b885-56dbe11795aa-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-8b2a33cb-f375-4452-b885-56dbe11795aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-8b2a33cb-f375-4452-b885-56dbe11795aa" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-8b2a33cb-f375-4452-b885-56dbe11795aa" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c34709-4545-42e3-aa62-d143eba6a485]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:59 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa Nov 02 11:01:59 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:01:59 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Nov 02 11:01:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa" returned: 0 in 0.674s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:01:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:01:59 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa Nov 02 11:01:59 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:00 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8b2a33cb-f375-4452-b885-56dbe11795aa" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-8b2a33cb-f375-4452-b885-56dbe11795aa" released by "delete_volume" :: held 1.170s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['a564f4f4-3444-4e78-b52c-497e02606d5a', 'd82f1eba-bf9f-457e-a5b9-32179dd91ff6', 'f6d65b0f-d593-4d43-b05b-369c9350731b', 'f5ab3d98-171a-424e-b997-70d7d0f98f58'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:00 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:00 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:00 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0b0c36f-936f-4a1d-911b-1391527a8fe9 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-8b2a33cb-f375-4452-b885-56dbe11795aa-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c88fa3-3f03-437c-8fc3-4222aa1cb087]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:01 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 Nov 02 11:02:01 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:02 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" returned: 0 in 0.603s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:02 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346 Nov 02 11:02:02 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:02 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346" released by "delete_volume" :: held 1.155s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['5a1843fb-9b6f-4171-a966-8e39b02bdffc', 'da4a8632-616e-4007-ac27-9de789128500', 'e46c50a9-83ad-4a27-a3d3-8cc487796665', '3209efbb-3e26-4986-893f-dfcdbe6d4dbb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:02 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:02 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:03 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5408e587-f690-4aec-ad58-8f29c2bb595f tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-fd2eea3d-2fdd-48ef-bac2-8fec0abd8346-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-bb6128f1-1b84-4dc0-b852-242c0fde1368-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-bb6128f1-1b84-4dc0-b852-242c0fde1368-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-bb6128f1-1b84-4dc0-b852-242c0fde1368" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-bb6128f1-1b84-4dc0-b852-242c0fde1368" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c6145e-4e9e-4fde-a8d8-73ca5b22c893]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:04 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 Nov 02 11:02:04 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:04 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368" returned: 0 in 0.559s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:04 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" returned: 0 in 8.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:02:04 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Converted 1024.00 MB image at 124.15 MB/s Nov 02 11:02:04 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 is being set with open permissions: ugo+rw Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:04 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368 Nov 02 11:02:04 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:04 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 Nov 02 11:02:04 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:04 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bb6128f1-1b84-4dc0-b852-242c0fde1368" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:04 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-bb6128f1-1b84-4dc0-b852-242c0fde1368" released by "delete_volume" :: held 0.890s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" released by "_copy_volume_from_snapshot" :: held 9.345s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" released by "_create_volume_from_snapshot" :: held 9.446s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.488s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['ae1a53d2-3fc4-4f0c-acc6-1a7929094052', '167db54b-5a86-42df-ba3e-31470dfd70c6', 'dcaaae91-0d98-4a13-91a0-5fbed90537b1', '35f69e4e-cdd3-4c8a-bf7c-c488dddbdb16'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4f2e12-c4e5-44fe-b176-01831a0635af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993', 'volume_size': 1, 'snapshot_id': 'cb2f7e27-86c7-4eeb-bf36-c6839d13e049'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43a291b-94fc-4993-80b3-f61349db2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Volume volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 (9f3edffd-ddbf-4eb7-9f3f-30327d1af993): created successfully Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43a291b-94fc-4993-80b3-f61349db2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Flow 'volume_create_manager' (548095e3-1807-4f1f-9479-d7e1b14b0401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-859406c5-1022-4a0a-b623-4e86bead4126 tempest-VolumeDependencyTests-1516442449 None] Created volume successfully. Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:05 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:05 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:05 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cc2aa752-67fc-40a3-b30e-153cb3cbb3bd tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-bb6128f1-1b84-4dc0-b852-242c0fde1368-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Deleting offline snapshot cb2f7e27-86c7-4eeb-bf36-c6839d13e049 of volume fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] snapshot_file for this snap is: volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9363d42-7382-48e6-a486-69ff4410baad]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:05 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:02:05 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-65a505b9-0a1f-4f5c-a744-4484395605e0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-65a505b9-0a1f-4f5c-a744-4484395605e0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-65a505b9-0a1f-4f5c-a744-4484395605e0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-65a505b9-0a1f-4f5c-a744-4484395605e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d7cab4-9f4d-4623-b349-5bbaee2849b6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:06 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:02:06 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 Nov 02 11:02:06 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3433858-42bc-42d9-aec0-b7cc98867db4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:06 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:02:06 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:06 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:06 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0 Nov 02 11:02:06 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:06 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-65a505b9-0a1f-4f5c-a744-4484395605e0" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-65a505b9-0a1f-4f5c-a744-4484395605e0" released by "delete_volume" :: held 0.746s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:06 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.609s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:06 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:02:06 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['9da5de15-406a-46c9-bbfd-a4235a241c40', 'ee5526d9-bba5-49b9-805e-a8dcaea5475d', 'fbca3c94-ddcc-4d6d-aa54-b8f6ec976956', 'a8d661ea-17ef-4ce8-9f3c-9e7bd3c1ab71'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:07 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:07 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "cinder-quobyte-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:07 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:07 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:07 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049 Nov 02 11:02:07 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a953b2-e089-402d-846d-25e4e8f75e02]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0b94129a-5def-4451-b165-8a26b8c76262 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-65a505b9-0a1f-4f5c-a744-4484395605e0-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:07 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 Nov 02 11:02:07 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:07 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c.cb2f7e27-86c7-4eeb-bf36-c6839d13e049" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-cb2f7e27-86c7-4eeb-bf36-c6839d13e049" released by "_delete_snapshot" :: held 1.955s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" released by "delete_snapshot" :: held 1.979s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Created reservations ['b878ab61-7bd2-4452-b8bd-f3d05a981a96', 'aba5254d-64ae-4968-8c03-203065240643', '66d08a8d-e747-421c-a530-8e39d83aab73', '5cab2877-1f73-4414-ae12-f318558a4766'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Delete snapshot completed successfully. Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-909c88ef-89f5-43e9-9e8f-bc838b250ed8 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-cb2f7e27-86c7-4eeb-bf36-c6839d13e049-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:07 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" returned: 0 in 0.457s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:07 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8 Nov 02 11:02:07 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:08 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-quobyte-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8" released by "delete_volume" :: held 0.760s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Created reservations ['6e2a5c36-7036-4d41-ac40-d465b6d906d5', '7e95c30a-81e5-4f7d-8bf2-69855871095d', '0a90b6a7-4e0b-4b16-98c1-08b3de790586', '78a3741d-ec0a-4291-a7fa-ac34a394757a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:08 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:08 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:08 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Deleted volume successfully. Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0384bdd5-f419-4764-b7f5-b3a0b13fb327 tempest-CreateVolumesFromSourceVolumeTest-956789982 None] Lock "cinder-8f0fc6bc-6b1d-4cdf-8f4a-b30a14ae8be8-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-fe08e4fd-556c-416a-b8c3-8427fe40ae0c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-fe08e4fd-556c-416a-b8c3-8427fe40ae0c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8e2c0-88ef-4fac-bcde-81c6869f2656]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:09 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:02:09 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:09 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:09 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c Nov 02 11:02:09 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:09 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:09 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:09 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-fe08e4fd-556c-416a-b8c3-8427fe40ae0c" released by "delete_volume" :: held 0.747s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Created reservations ['71def3e9-7b6f-418c-a921-79bc788c4c51', '44e27ba0-a24b-4ce4-882a-ac9526f28ab6', 'bf8fdeab-c6aa-4f94-aed4-64937085ea1b', '3ac4c262-2909-4b39-bcad-653cef6894b5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:09 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:09 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:09 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-9f3edffd-ddbf-4eb7-9f3f-30327d1af993-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-9f3edffd-ddbf-4eb7-9f3f-30327d1af993-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:10 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.280s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Deleted volume successfully. Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-14b622f7-9704-4698-a153-bbb6f68634f2 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-fe08e4fd-556c-416a-b8c3-8427fe40ae0c-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4a5628-def0-4410-abc4-465e7ae3fd06]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:10 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 Nov 02 11:02:10 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:10 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:10 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993 Nov 02 11:02:10 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:10 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-quobyte-9f3edffd-ddbf-4eb7-9f3f-30327d1af993" released by "delete_volume" :: held 0.671s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Created reservations ['10260336-999f-422c-9a00-3227ed0365d0', '91967b9e-0cbe-4e5a-86cc-4be16739efa5', '45c7d1b2-7494-4348-9a73-7f339d33b999', '40b9806b-7cd5-4aed-aadc-6a61b2f48583'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:10 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:10 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:11 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Deleted volume successfully. Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=220,cinder:SELECT=136,cinder:INSERT=46,cinder:DELETE=14 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31576d15-b925-45c1-a883-d7c0aa360c72 tempest-VolumeDependencyTests-1516442449 None] Lock "cinder-9f3edffd-ddbf-4eb7-9f3f-30327d1af993-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=154,cinder:UPDATE=181,cinder:DELETE=21,cinder:INSERT=57 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Flow 'volume_create_manager' (4187294a-fd62-4c7e-a891-f524d8477bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ce7730-fdb6-4e65-8df0-fb7942996ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ce7730-fdb6-4e65-8df0-fb7942996ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721697070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139d8c5f-bf22-488a-8f0a-cf19d2988df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c43205178bf49479d54cc85eb87cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:12Z,use_quota=True,user_id='b05e6934d1d34307841f94119d6ea43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9af773-4302-48fe-bd32-8197f5e5432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9af773-4302-48fe-bd32-8197f5e5432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b35013-47df-4ba0-80af-3395a2f3848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b35013-47df-4ba0-80af-3395a2f3848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139d8c5f-bf22-488a-8f0a-cf19d2988df2', 'volume_name': 'volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a489fa-ad2a-4f18-9928-79904a3faa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a489fa-ad2a-4f18-9928-79904a3faa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd9dd35-af32-4b0f-a59a-aeeb74118a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Volume 139d8c5f-bf22-488a-8f0a-cf19d2988df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2', 'volume_size': 1} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721697070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139d8c5f-bf22-488a-8f0a-cf19d2988df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c43205178bf49479d54cc85eb87cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:12Z,use_quota=True,user_id='b05e6934d1d34307841f94119d6ea43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Creating volume 139d8c5f-bf22-488a-8f0a-cf19d2988df2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:12 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:12 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 1073741824 Nov 02 11:02:12 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:12 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 1073741824" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:12 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 Nov 02 11:02:12 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:12 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd9dd35-af32-4b0f-a59a-aeeb74118a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00ece29-f8e6-47b3-ab1e-ec57b82bb507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Volume volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 (139d8c5f-bf22-488a-8f0a-cf19d2988df2): created successfully Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00ece29-f8e6-47b3-ab1e-ec57b82bb507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Flow 'volume_create_manager' (4187294a-fd62-4c7e-a891-f524d8477bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4eae98c8-d6b7-44f4-9d74-d0e71c7e420e tempest-ProjectReaderTests-540729126 None] Created volume successfully. Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Acquiring lock "cinder-139d8c5f-bf22-488a-8f0a-cf19d2988df2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "cinder-139d8c5f-bf22-488a-8f0a-cf19d2988df2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Acquiring lock "cinder-quobyte-139d8c5f-bf22-488a-8f0a-cf19d2988df2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "cinder-quobyte-139d8c5f-bf22-488a-8f0a-cf19d2988df2" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b29dcf-b539-45d2-80e1-09d8beb50e2f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:13 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 Nov 02 11:02:13 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:13 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:13 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2 Nov 02 11:02:13 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:13 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-139d8c5f-bf22-488a-8f0a-cf19d2988df2" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "cinder-quobyte-139d8c5f-bf22-488a-8f0a-cf19d2988df2" released by "delete_volume" :: held 0.660s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Created reservations ['5a8490fd-ffa7-465b-89d0-0551466237cf', 'd3843591-4a73-48db-823a-c635380695e5', 'e974a97c-d3a4-464f-933c-5bdeb8ab9f91', '9d0bbcda-62c0-4e5f-b1d1-ea5237181d7c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:14 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:14 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Flow 'volume_create_manager' (541c6a2d-f61d-410c-bd58-31ceb1b73ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e712931-2eb1-4755-9ca7-b88d87d1ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e712931-2eb1-4755-9ca7-b88d87d1ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9238f4-a552-47aa-8590-c18431263d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbeb6e194a4cbcb9664fc5bb9c0b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:14Z,use_quota=True,user_id='217e814cb1f14dd68ab0700be07ffe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a66a0ba-46d2-46d1-99a7-ffd3cf8b517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a66a0ba-46d2-46d1-99a7-ffd3cf8b517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7d2ccf-6dde-468a-aede-0b468305c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7d2ccf-6dde-468a-aede-0b468305c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9238f4-a552-47aa-8590-c18431263d07', 'volume_name': 'volume-dd9238f4-a552-47aa-8590-c18431263d07', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423bff6-774c-4d50-a5d9-c6268404b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423bff6-774c-4d50-a5d9-c6268404b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f7f356-0a77-4df4-bd53-69a502221c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Volume dd9238f4-a552-47aa-8590-c18431263d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9238f4-a552-47aa-8590-c18431263d07', 'volume_size': 1} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9238f4-a552-47aa-8590-c18431263d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbeb6e194a4cbcb9664fc5bb9c0b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:14Z,use_quota=True,user_id='217e814cb1f14dd68ab0700be07ffe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Creating volume dd9238f4-a552-47aa-8590-c18431263d07 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Deleted volume successfully. Nov 02 11:02:14 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 1073741824 Nov 02 11:02:14 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a666ce5e-893c-4aaf-a780-c936be47a5a0 tempest-ProjectReaderTests-540729126 None] Lock "cinder-139d8c5f-bf22-488a-8f0a-cf19d2988df2-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Flow 'volume_create_manager' (72e8844e-49ab-40d0-a812-fd441221e8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dfeb8c-a8be-44b6-9fd8-92522ada19dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dfeb8c-a8be-44b6-9fd8-92522ada19dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184035315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e194643c-474c-4c05-88d9-8d335ddcffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c43205178bf49479d54cc85eb87cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:15Z,use_quota=True,user_id='b05e6934d1d34307841f94119d6ea43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae309dd-22b2-48e8-a964-003974120f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae309dd-22b2-48e8-a964-003974120f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da47ad2c-d9a2-4643-bb78-5bcc869c2f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da47ad2c-d9a2-4643-bb78-5bcc869c2f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e194643c-474c-4c05-88d9-8d335ddcffac', 'volume_name': 'volume-e194643c-474c-4c05-88d9-8d335ddcffac', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1221e97-03af-4884-a3d4-76f66a9c665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1221e97-03af-4884-a3d4-76f66a9c665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030775e9-e765-4720-b81c-42aa3e9af4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Volume e194643c-474c-4c05-88d9-8d335ddcffac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e194643c-474c-4c05-88d9-8d335ddcffac', 'volume_size': 1} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 1073741824" returned: 0 in 0.537s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:15 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 Nov 02 11:02:15 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:15 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184035315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e194643c-474c-4c05-88d9-8d335ddcffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c43205178bf49479d54cc85eb87cc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:15Z,use_quota=True,user_id='b05e6934d1d34307841f94119d6ea43c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Creating volume e194643c-474c-4c05-88d9-8d335ddcffac {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:15 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f7f356-0a77-4df4-bd53-69a502221c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9238f4-a552-47aa-8590-c18431263d07', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f39907-a000-4802-85ac-290d4cee36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:15 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac 1073741824 Nov 02 11:02:15 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Volume volume-dd9238f4-a552-47aa-8590-c18431263d07 (dd9238f4-a552-47aa-8590-c18431263d07): created successfully Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f39907-a000-4802-85ac-290d4cee36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Flow 'volume_create_manager' (541c6a2d-f61d-410c-bd58-31ceb1b73ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-77dcee31-1187-4646-8a82-dd53244e511a tempest-CinderUnicodeTest-1108594557 None] Created volume successfully. Nov 02 11:02:15 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac 1073741824" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:15 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac Nov 02 11:02:15 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:15 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030775e9-e765-4720-b81c-42aa3e9af4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e194643c-474c-4c05-88d9-8d335ddcffac', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e4e0ae-f95e-4929-af8a-bf854b1dd30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Volume volume-e194643c-474c-4c05-88d9-8d335ddcffac (e194643c-474c-4c05-88d9-8d335ddcffac): created successfully Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e4e0ae-f95e-4929-af8a-bf854b1dd30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Flow 'volume_create_manager' (72e8844e-49ab-40d0-a812-fd441221e8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1a7e026b-15e6-479c-91c2-58e5f16b9a15 tempest-ProjectReaderTests-540729126 None] Created volume successfully. Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Flow 'volume_create_manager' (18b27989-762b-4fd0-859c-d2c006940b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cb0e58-618e-425c-bd4a-33e6117a3fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cb0e58-618e-425c-bd4a-33e6117a3fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1060936325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1aff454-373d-483b-a54f-e7bb5156fb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbeb6e194a4cbcb9664fc5bb9c0b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:17Z,use_quota=True,user_id='217e814cb1f14dd68ab0700be07ffe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31cd5ec-9a96-4f10-9371-8c59a7df29e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31cd5ec-9a96-4f10-9371-8c59a7df29e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e105d9f1-0ffe-4152-a53a-53ff97f96e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e105d9f1-0ffe-4152-a53a-53ff97f96e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1aff454-373d-483b-a54f-e7bb5156fb35', 'volume_name': 'volume-b1aff454-373d-483b-a54f-e7bb5156fb35', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb83900-3f91-4921-89ec-41a59ecbac2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb83900-3f91-4921-89ec-41a59ecbac2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e20c508-9737-46ac-8a64-45ae4a530f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Volume b1aff454-373d-483b-a54f-e7bb5156fb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1aff454-373d-483b-a54f-e7bb5156fb35', 'volume_size': 1} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1060936325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1aff454-373d-483b-a54f-e7bb5156fb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cbeb6e194a4cbcb9664fc5bb9c0b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:17Z,use_quota=True,user_id='217e814cb1f14dd68ab0700be07ffe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Creating volume b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:16 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 1073741824 Nov 02 11:02:16 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Acquiring lock "cinder-e194643c-474c-4c05-88d9-8d335ddcffac-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "cinder-e194643c-474c-4c05-88d9-8d335ddcffac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Acquiring lock "cinder-quobyte-e194643c-474c-4c05-88d9-8d335ddcffac" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "cinder-quobyte-e194643c-474c-4c05-88d9-8d335ddcffac" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a679b-e1fb-4f34-9500-003720f9041e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:17 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac Nov 02 11:02:17 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:17 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 1073741824" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:17 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 Nov 02 11:02:17 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:17 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:17 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac Nov 02 11:02:17 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:17 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e20c508-9737-46ac-8a64-45ae4a530f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1aff454-373d-483b-a54f-e7bb5156fb35', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785d2cee-4d6d-475e-8dd3-f9db2ac0819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:17 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Volume volume-b1aff454-373d-483b-a54f-e7bb5156fb35 (b1aff454-373d-483b-a54f-e7bb5156fb35): created successfully Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785d2cee-4d6d-475e-8dd3-f9db2ac0819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Flow 'volume_create_manager' (18b27989-762b-4fd0-859c-d2c006940b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e194643c-474c-4c05-88d9-8d335ddcffac" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b979ea03-acb4-47a8-b694-9af2b8e67d7c tempest-CinderUnicodeTest-1108594557 None] Created volume successfully. Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "cinder-quobyte-e194643c-474c-4c05-88d9-8d335ddcffac" released by "delete_volume" :: held 0.683s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Created reservations ['365e3bb8-2c6f-430d-b403-e1a49735058e', '98e71f3d-0774-4056-8646-a3f993b616f7', '2d1ee969-f113-419b-843d-4d7f4f6f8b23', '0993fd06-5982-4548-85d0-01cea8622b7d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:17 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:17 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:18 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Deleted volume successfully. Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Creating offline snapshot a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 of volume b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-674236e6-0b8e-4dd7-8634-4acbcbd2c19a tempest-ProjectReaderTests-540729126 None] Lock "cinder-e194643c-474c-4c05-88d9-8d335ddcffac-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a18b0c-da06-40f9-b287-c52d884026fc]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:18 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 Nov 02 11:02:18 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:18 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:18 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 1G Nov 02 11:02:18 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:19 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 1G" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1aff454-373d-483b-a54f-e7bb5156fb35 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:19 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1aff454-373d-483b-a54f-e7bb5156fb35 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 Nov 02 11:02:19 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:19 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1aff454-373d-483b-a54f-e7bb5156fb35 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:19 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 is being set with open permissions: ugo+rw Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:19 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 Nov 02 11:02:19 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:19 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:19 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info Nov 02 11:02:19 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:19 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:19 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info is being set with open permissions: ugo+rw Nov 02 11:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:19 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info Nov 02 11:02:19 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:20 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.info" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5d5a2264-8347-4af0-9f6f-d160344675f1 tempest-CinderUnicodeTest-1108594557 None] Create snapshot completed successfully Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-quobyte-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Deleting offline snapshot a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 of volume b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] snapshot_file for this snap is: volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940de70-34a7-460e-91f6-53c9d5ed5226]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:21 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 Nov 02 11:02:21 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:21 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1aff454-373d-483b-a54f-e7bb5156fb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2e9b9-f54a-480a-90f9-b9e3adbb4257]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:21 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 Nov 02 11:02:21 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:22 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35" returned: 0 in 0.341s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:22 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 Nov 02 11:02:22 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:22 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:22 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9 Nov 02 11:02:22 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:22 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35.a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9" released by "_delete_snapshot" :: held 1.352s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" released by "delete_snapshot" :: held 1.374s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Created reservations ['683dede6-d2fa-4c86-b2c9-7d5450d67ac0', '7b6333fc-b2df-4edb-b7b8-b55ab50973a3', '3ce557f6-f81b-4c54-8b14-13a9bf9ed5be', '8045495b-6f2a-408a-b1bd-f9a41bfa1914'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Delete snapshot completed successfully. Nov 02 11:02:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7726eb73-0e54-423e-a106-ffafe9864950 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-a3c0b90c-a0ca-4452-95a8-4cc89cd0dfb9-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-b1aff454-373d-483b-a54f-e7bb5156fb35-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-b1aff454-373d-483b-a54f-e7bb5156fb35-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd134641-5bc5-4534-95b2-ca070785a01e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:23 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 Nov 02 11:02:23 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:23 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:23 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35 Nov 02 11:02:23 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:24 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b1aff454-373d-483b-a54f-e7bb5156fb35" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-b1aff454-373d-483b-a54f-e7bb5156fb35" released by "delete_volume" :: held 0.652s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Created reservations ['01574723-aa66-4fae-a763-75d96287425f', 'ad98fec5-3b2f-492f-8dea-17ce7f171f58', '8730c404-4fbf-4168-a509-a3a26af4de01', 'c5fab505-f0dc-48ef-9384-a0e60aac82e6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:24 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:24 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:24 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.233s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Deleted volume successfully. Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ee88db90-4e94-483a-8f9b-6abde3a23334 tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-b1aff454-373d-483b-a54f-e7bb5156fb35-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-dd9238f4-a552-47aa-8590-c18431263d07-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-dd9238f4-a552-47aa-8590-c18431263d07-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "cinder-quobyte-dd9238f4-a552-47aa-8590-c18431263d07" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-dd9238f4-a552-47aa-8590-c18431263d07" acquired by "delete_volume" :: waited 0.012s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a756f80-c492-4506-ba58-2ea1b6fc19d5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:24 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 Nov 02 11:02:24 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:25 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:25 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07 Nov 02 11:02:25 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:25 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dd9238f4-a552-47aa-8590-c18431263d07" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-quobyte-dd9238f4-a552-47aa-8590-c18431263d07" released by "delete_volume" :: held 0.650s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Created reservations ['603c4f51-80db-43be-89da-7ecb512b3adc', 'd73e799c-2962-4f13-a024-fc18467b60aa', 'f22f0917-bba3-4ef3-97e7-e1b101f4a87d', 'ed4f0eea-94da-4701-b9c4-4bd77976bd7f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:25 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:25 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:25 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Deleted volume successfully. Nov 02 11:02:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9917dbc7-1e56-4ce6-a7e9-aafc92b0999a tempest-CinderUnicodeTest-1108594557 None] Lock "cinder-dd9238f4-a552-47aa-8590-c18431263d07-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (96a16644-4592-4078-a2ac-ea5832471b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e30d32-8916-487e-a986-a0c4a1ef884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e30d32-8916-487e-a986-a0c4a1ef884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960235008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38218024-1d55-4eca-bc5d-28d99dc44ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:29Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b10ac8f-d534-4d5c-aea0-0ae8eff15b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b10ac8f-d534-4d5c-aea0-0ae8eff15b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a60e7c-f799-4fb6-ad09-b33c968a758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a60e7c-f799-4fb6-ad09-b33c968a758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38218024-1d55-4eca-bc5d-28d99dc44ca2', 'volume_name': 'volume-38218024-1d55-4eca-bc5d-28d99dc44ca2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897c55d1-5e3c-4262-845c-e0c5d099307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897c55d1-5e3c-4262-845c-e0c5d099307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e030d86-e081-4d80-908c-067215b67dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Volume 38218024-1d55-4eca-bc5d-28d99dc44ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38218024-1d55-4eca-bc5d-28d99dc44ca2', 'volume_size': 1} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960235008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38218024-1d55-4eca-bc5d-28d99dc44ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:29Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Creating volume 38218024-1d55-4eca-bc5d-28d99dc44ca2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:29 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 1073741824 Nov 02 11:02:29 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:29 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 1073741824" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:29 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 Nov 02 11:02:29 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:29 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e030d86-e081-4d80-908c-067215b67dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38218024-1d55-4eca-bc5d-28d99dc44ca2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d9d1b-d989-4271-b1aa-9a35b2a8f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Volume volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 (38218024-1d55-4eca-bc5d-28d99dc44ca2): created successfully Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d9d1b-d989-4271-b1aa-9a35b2a8f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (96a16644-4592-4078-a2ac-ea5832471b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9dc7b608-a587-48c6-8c12-b841c77e1dd6 tempest-ProjectReaderTests-377173434 None] Created volume successfully. Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-38218024-1d55-4eca-bc5d-28d99dc44ca2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "cinder-38218024-1d55-4eca-bc5d-28d99dc44ca2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-quobyte-38218024-1d55-4eca-bc5d-28d99dc44ca2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-38218024-1d55-4eca-bc5d-28d99dc44ca2" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[12910a7b-86cd-4622-908f-54115b7b465c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:30 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 Nov 02 11:02:30 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:30 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:30 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2 Nov 02 11:02:30 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:30 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-38218024-1d55-4eca-bc5d-28d99dc44ca2" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-38218024-1d55-4eca-bc5d-28d99dc44ca2" released by "delete_volume" :: held 0.636s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Created reservations ['617223f2-ac24-4aef-8a3f-9dab818c8b33', '69463539-69b0-44c5-a08a-efa338b800fa', 'd18be960-274a-4399-af5d-697aabaac6ea', 'c6087de1-9083-4e57-b185-a335f6c21aa4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:30 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:30 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:31 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.233s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Deleted volume successfully. Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-59697ad3-21c5-4e1f-8ddb-8c1001aa2437 tempest-ProjectReaderTests-377173434 None] Lock "cinder-38218024-1d55-4eca-bc5d-28d99dc44ca2-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (d84dbdb4-3e97-477b-b2fd-b1d111620895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bd59e-f83a-4945-aa9d-c461f4b2eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bd59e-f83a-4945-aa9d-c461f4b2eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241009242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c832b46-88d4-478e-8a65-9d85e8f04391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:32Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be6e43b-0f51-4b42-916d-475e17a759bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9be6e43b-0f51-4b42-916d-475e17a759bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0cce6e-ede6-4fe9-ae35-18c27675f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0cce6e-ede6-4fe9-ae35-18c27675f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c832b46-88d4-478e-8a65-9d85e8f04391', 'volume_name': 'volume-9c832b46-88d4-478e-8a65-9d85e8f04391', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad564922-4a90-4c22-8e81-fdfe1ba4cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad564922-4a90-4c22-8e81-fdfe1ba4cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8983509-6510-45fc-97bf-f869df13b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Volume 9c832b46-88d4-478e-8a65-9d85e8f04391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c832b46-88d4-478e-8a65-9d85e8f04391', 'volume_size': 1} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241009242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c832b46-88d4-478e-8a65-9d85e8f04391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:32Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Creating volume 9c832b46-88d4-478e-8a65-9d85e8f04391 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:31 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 1073741824 Nov 02 11:02:31 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:32 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 1073741824" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:32 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 Nov 02 11:02:32 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:32 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8983509-6510-45fc-97bf-f869df13b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c832b46-88d4-478e-8a65-9d85e8f04391', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7748f03b-031f-4722-90f4-b8fbd5f30dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Volume volume-9c832b46-88d4-478e-8a65-9d85e8f04391 (9c832b46-88d4-478e-8a65-9d85e8f04391): created successfully Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7748f03b-031f-4722-90f4-b8fbd5f30dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (d84dbdb4-3e97-477b-b2fd-b1d111620895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b1c92dd-f59e-4ad1-82fd-fb7d0a4cb290 tempest-ProjectReaderTests-377173434 None] Created volume successfully. Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-9c832b46-88d4-478e-8a65-9d85e8f04391-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "cinder-9c832b46-88d4-478e-8a65-9d85e8f04391-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-quobyte-9c832b46-88d4-478e-8a65-9d85e8f04391" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-9c832b46-88d4-478e-8a65-9d85e8f04391" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef92f43-cd87-44ab-892d-e14410589fd1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:32 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 Nov 02 11:02:32 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:33 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:33 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391 Nov 02 11:02:33 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:33 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-9c832b46-88d4-478e-8a65-9d85e8f04391" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-9c832b46-88d4-478e-8a65-9d85e8f04391" released by "delete_volume" :: held 0.632s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Created reservations ['1277182d-7882-478a-b091-2130f1cce114', '8ad44660-d795-42d7-b243-b4e2556da26a', '8a4bca60-430b-4df9-874c-169d2b8b262b', '6b74f61f-4629-4fb7-af71-27953bbd993e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:33 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:33 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:33 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Deleted volume successfully. Nov 02 11:02:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0db1268e-748f-40d2-81f8-0c9c277f9b02 tempest-ProjectReaderTests-377173434 None] Lock "cinder-9c832b46-88d4-478e-8a65-9d85e8f04391-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (806686fc-d0e6-4ffa-8333-9754ce301da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63344891-8b2c-4276-a625-0d04e418ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63344891-8b2c-4276-a625-0d04e418ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517222144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09b215b-db62-4d35-b4cd-b3f6b37d5efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:34Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf8bfc-e35b-4099-8882-9de4fe670552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcf8bfc-e35b-4099-8882-9de4fe670552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b352040f-eb5c-4564-abd6-1f7c6b6cb9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b352040f-eb5c-4564-abd6-1f7c6b6cb9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09b215b-db62-4d35-b4cd-b3f6b37d5efc', 'volume_name': 'volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0f28b2-99e6-41ce-818a-4ff15ba16b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0f28b2-99e6-41ce-818a-4ff15ba16b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3c76f0-1beb-46c3-be33-c41d9fef1ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Volume f09b215b-db62-4d35-b4cd-b3f6b37d5efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc', 'volume_size': 1} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517222144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09b215b-db62-4d35-b4cd-b3f6b37d5efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:34Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Creating volume f09b215b-db62-4d35-b4cd-b3f6b37d5efc {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:34 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc 1073741824 Nov 02 11:02:34 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:34 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc 1073741824" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:34 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc Nov 02 11:02:34 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:35 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3c76f0-1beb-46c3-be33-c41d9fef1ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8172e42-023d-4b12-80e5-49c35e4670fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Volume volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc (f09b215b-db62-4d35-b4cd-b3f6b37d5efc): created successfully Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8172e42-023d-4b12-80e5-49c35e4670fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (806686fc-d0e6-4ffa-8333-9754ce301da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-39479a4b-c4ea-4c5a-bdf8-52b0d71d6a31 tempest-ProjectReaderTests-377173434 None] Created volume successfully. Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-f09b215b-db62-4d35-b4cd-b3f6b37d5efc-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "cinder-f09b215b-db62-4d35-b4cd-b3f6b37d5efc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-quobyte-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d10f0db-aad8-4776-9181-e251d3d6137d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:35 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc Nov 02 11:02:35 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:35 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:35 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc Nov 02 11:02:35 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:36 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-f09b215b-db62-4d35-b4cd-b3f6b37d5efc" released by "delete_volume" :: held 0.647s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Created reservations ['abebeecf-6154-4ffe-b2aa-a8e62257ab1d', '22a021c9-295d-4591-9127-ff11611a75c9', '2f007159-ddb6-491a-9bb2-6469ed1c7268', '319a0080-e26a-42e5-86d2-1f8f1fb42657'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:36 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:36 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:36 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Deleted volume successfully. Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4b2f4ea8-ad7f-4ad5-a0a4-bf84d0ec80f4 tempest-ProjectReaderTests-377173434 None] Lock "cinder-f09b215b-db62-4d35-b4cd-b3f6b37d5efc-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (8f65a524-45ec-4bb7-aa9e-351e1bcc8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4b153c-8f20-4df6-8c28-1136cab82a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4b153c-8f20-4df6-8c28-1136cab82a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388326115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69660b42-2c60-43f1-9c63-8e5cf7b351dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:37Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d6df27-9081-41bd-a0a1-c2fe6c752369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d6df27-9081-41bd-a0a1-c2fe6c752369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8425a370-a6dd-4fbb-926c-bf188dc4f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8425a370-a6dd-4fbb-926c-bf188dc4f78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69660b42-2c60-43f1-9c63-8e5cf7b351dd', 'volume_name': 'volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c36b43-1c63-4458-90ef-b519042f36b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c36b43-1c63-4458-90ef-b519042f36b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042ae0d6-30fa-4492-a7b5-fd05fe3d97cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Volume 69660b42-2c60-43f1-9c63-8e5cf7b351dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd', 'volume_size': 1} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388326115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69660b42-2c60-43f1-9c63-8e5cf7b351dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f728344680c4bef9bd4564696d0f628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:37Z,use_quota=True,user_id='8541e4bce2084dbc8a88d8bd605e8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Creating volume 69660b42-2c60-43f1-9c63-8e5cf7b351dd {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:36 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:37 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd 1073741824 Nov 02 11:02:37 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:37 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd 1073741824" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:37 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd Nov 02 11:02:37 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:37 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042ae0d6-30fa-4492-a7b5-fd05fe3d97cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4d3e4f-774b-4cb8-af98-1e9aab58c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Volume volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd (69660b42-2c60-43f1-9c63-8e5cf7b351dd): created successfully Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4d3e4f-774b-4cb8-af98-1e9aab58c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Flow 'volume_create_manager' (8f65a524-45ec-4bb7-aa9e-351e1bcc8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d2e5b238-8442-4ae1-bb57-bd84beb11f1e tempest-ProjectReaderTests-377173434 None] Created volume successfully. Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-69660b42-2c60-43f1-9c63-8e5cf7b351dd-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "cinder-69660b42-2c60-43f1-9c63-8e5cf7b351dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Acquiring lock "cinder-quobyte-69660b42-2c60-43f1-9c63-8e5cf7b351dd" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-69660b42-2c60-43f1-9c63-8e5cf7b351dd" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0e2004-645b-4d8a-b714-698057063513]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:38 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd Nov 02 11:02:38 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:38 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:38 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd Nov 02 11:02:38 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:38 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-69660b42-2c60-43f1-9c63-8e5cf7b351dd" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "cinder-quobyte-69660b42-2c60-43f1-9c63-8e5cf7b351dd" released by "delete_volume" :: held 0.625s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Created reservations ['0e5b1f7c-cc0b-4037-a5bc-7a80a0f16e9f', '9528bf2c-7b22-4ba7-91a6-2f122fabc640', '25b52103-3d5c-46e3-87ce-83d1ea8c462f', '9f155e38-c2ec-4e60-9045-88793cc4fb5d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:38 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:38 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:38 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Deleted volume successfully. Nov 02 11:02:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-96855ef2-fb97-4e8f-a9c7-49e38227af33 tempest-ProjectReaderTests-377173434 None] Lock "cinder-69660b42-2c60-43f1-9c63-8e5cf7b351dd-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:48 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=100,cinder:SELECT=60,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:02:48 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=90,cinder:SELECT=69,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (beb38749-d625-41e5-99e5-2914767bfd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d1fac6-5cb7-4f78-9570-cf039599e824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d1fac6-5cb7-4f78-9570-cf039599e824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599060390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7806c9e-ba67-4566-986d-42e35af3dd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b2cf1-6a19-4f12-a607-637d73e7ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5b2cf1-6a19-4f12-a607-637d73e7ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f5322e-e716-48b5-9fee-eb5fc271723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f5322e-e716-48b5-9fee-eb5fc271723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7806c9e-ba67-4566-986d-42e35af3dd9a', 'volume_name': 'volume-c7806c9e-ba67-4566-986d-42e35af3dd9a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6d7221-10fb-4f33-99f8-a7ec2183f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6d7221-10fb-4f33-99f8-a7ec2183f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5e7c2f-a9a7-4f63-9c70-5cc36b18ea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Volume c7806c9e-ba67-4566-986d-42e35af3dd9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7806c9e-ba67-4566-986d-42e35af3dd9a', 'volume_size': 1} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599060390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7806c9e-ba67-4566-986d-42e35af3dd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Creating volume c7806c9e-ba67-4566-986d-42e35af3dd9a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:51 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a 1073741824 Nov 02 11:02:51 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (230354f8-809b-41f2-843f-3fc33cd0a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caed6d18-51e9-49dc-a6aa-eefbdf2988d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caed6d18-51e9-49dc-a6aa-eefbdf2988d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289489475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3784342f-bd1c-4e52-a603-e19ecd244f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30757628-d3e5-43d6-9e70-909c91c81c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30757628-d3e5-43d6-9e70-909c91c81c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ced199-b7de-47d8-89b8-9d1b31897c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ced199-b7de-47d8-89b8-9d1b31897c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3784342f-bd1c-4e52-a603-e19ecd244f50', 'volume_name': 'volume-3784342f-bd1c-4e52-a603-e19ecd244f50', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b05750-4848-4207-a5ce-cb017d1f379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b05750-4848-4207-a5ce-cb017d1f379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa4959d-883c-46b4-82ed-831c40d9e06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume 3784342f-bd1c-4e52-a603-e19ecd244f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3784342f-bd1c-4e52-a603-e19ecd244f50', 'volume_size': 1} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (8fadf69f-9b5a-46fe-abf8-ccf7ac74ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e30b60c-0782-47fa-a993-58baaf5f2329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e30b60c-0782-47fa-a993-58baaf5f2329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545371758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a8cee1-6662-410d-a41d-08ea25fc5ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7164b0a-67f4-44e6-a4cf-6e7bcbb15dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7164b0a-67f4-44e6-a4cf-6e7bcbb15dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0bb905-0c00-4e7e-93e1-7bbe41ab0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0bb905-0c00-4e7e-93e1-7bbe41ab0431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a8cee1-6662-410d-a41d-08ea25fc5ac2', 'volume_name': 'volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a41805-bb66-4363-bf96-d369c4e2ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a41805-bb66-4363-bf96-d369c4e2ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052e7dd-1f0c-4afc-94ef-d13010d89663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Volume 55a8cee1-6662-410d-a41d-08ea25fc5ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2', 'volume_size': 1} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:51 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a 1073741824" returned: 0 in 0.799s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (74cd0cc8-067c-4267-8818-9b606311505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7d3a7e-9fb3-4a67-bd86-c34ca0fb140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7d3a7e-9fb3-4a67-bd86-c34ca0fb140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271944312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4fd1bb-694b-4f03-b468-b9c7ec9711a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:52Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226c40b-61d4-4990-b7a9-1fc6de3fb751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226c40b-61d4-4990-b7a9-1fc6de3fb751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38390ab4-ddb1-45c9-9d47-9f7e163bde76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38390ab4-ddb1-45c9-9d47-9f7e163bde76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4fd1bb-694b-4f03-b468-b9c7ec9711a0', 'volume_name': 'volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1421bfc0-a512-4e66-804f-3820e995895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1421bfc0-a512-4e66-804f-3820e995895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363f108-1718-4d82-9fb4-8e1eba70ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Volume cd4fd1bb-694b-4f03-b468-b9c7ec9711a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0', 'volume_size': 1} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:52 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a Nov 02 11:02:52 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:52 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (c352f44c-2d69-4195-b863-d256f7cf3501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afd29f5-3d24-4d98-b6fd-b1bd383083a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289489475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3784342f-bd1c-4e52-a603-e19ecd244f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume 3784342f-bd1c-4e52-a603-e19ecd244f50 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:52 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 1073741824 Nov 02 11:02:52 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3afd29f5-3d24-4d98-b6fd-b1bd383083a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808760726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b62fff-4aa9-485b-aa88-80e6fb50a1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:52Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f754a4b7-a8ae-449a-a125-7b27fc86150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f754a4b7-a8ae-449a-a125-7b27fc86150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcc0da0-761c-43f6-88aa-68fd49c5080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adcc0da0-761c-43f6-88aa-68fd49c5080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b62fff-4aa9-485b-aa88-80e6fb50a1b2', 'volume_name': 'volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6894da74-10d8-4b24-abac-501ffa1d3c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6894da74-10d8-4b24-abac-501ffa1d3c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3fa006-c2cb-4296-a89d-8896f851f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Volume c9b62fff-4aa9-485b-aa88-80e6fb50a1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2', 'volume_size': 1} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5e7c2f-a9a7-4f63-9c70-5cc36b18ea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7806c9e-ba67-4566-986d-42e35af3dd9a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb41d08-d5ec-4e40-b6e9-f572893b8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Volume volume-c7806c9e-ba67-4566-986d-42e35af3dd9a (c7806c9e-ba67-4566-986d-42e35af3dd9a): created successfully Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb41d08-d5ec-4e40-b6e9-f572893b8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (beb38749-d625-41e5-99e5-2914767bfd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d7b7baa9-bfd6-490c-8094-85fb83593dee tempest-CreateVolumesFromImageTest-80262407 None] Created volume successfully. Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (89058eb7-f238-4bc3-a808-7968b36267c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c1b50-fffb-409b-ac1f-4f18846080e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c1b50-fffb-409b-ac1f-4f18846080e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577922762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e3524c-a0fe-468a-bc72-5bc2bcb69a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:53Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00648b87-de70-4e30-ace1-45b01541d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00648b87-de70-4e30-ace1-45b01541d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c52433b-b808-414c-b46e-6e8f6c079146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c52433b-b808-414c-b46e-6e8f6c079146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e3524c-a0fe-468a-bc72-5bc2bcb69a10', 'volume_name': 'volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362c276-c15e-4106-8de5-bb35f70382b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362c276-c15e-4106-8de5-bb35f70382b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7617ee-2cb1-4e45-9810-3b060af6c05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Volume 80e3524c-a0fe-468a-bc72-5bc2bcb69a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10', 'volume_size': 1} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (58fdf8b6-83fa-4c91-90a2-c570e431508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937428d7-acb1-4511-857c-189c0d960616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937428d7-acb1-4511-857c-189c0d960616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943084505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22689091-53f8-4470-aa31-b39d14a6bde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:53Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7663c1b6-5425-4f57-8591-f6e21ec3e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7663c1b6-5425-4f57-8591-f6e21ec3e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc42aa-e69c-44dd-906b-678ffb85958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc42aa-e69c-44dd-906b-678ffb85958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22689091-53f8-4470-aa31-b39d14a6bde1', 'volume_name': 'volume-22689091-53f8-4470-aa31-b39d14a6bde1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da04a31d-5a72-4cac-9fed-acf4a92c1e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da04a31d-5a72-4cac-9fed-acf4a92c1e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87fbd7f-72f2-45e9-9d90-075097dc17a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Volume 22689091-53f8-4470-aa31-b39d14a6bde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22689091-53f8-4470-aa31-b39d14a6bde1', 'volume_size': 1} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:53 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 1073741824" returned: 0 in 0.612s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:53 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 Nov 02 11:02:53 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:53 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545371758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a8cee1-6662-410d-a41d-08ea25fc5ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:51Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Creating volume 55a8cee1-6662-410d-a41d-08ea25fc5ac2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa4959d-883c-46b4-82ed-831c40d9e06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3784342f-bd1c-4e52-a603-e19ecd244f50', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 1073741824 Nov 02 11:02:53 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330dbc9b-b497-4ad0-8e9e-a18e04d75a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-3784342f-bd1c-4e52-a603-e19ecd244f50 (3784342f-bd1c-4e52-a603-e19ecd244f50): created successfully Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330dbc9b-b497-4ad0-8e9e-a18e04d75a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (230354f8-809b-41f2-843f-3fc33cd0a80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-76f10fa8-af22-41c2-b174-f8dc04c99ed5 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:02:53 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 1073741824" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:53 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 Nov 02 11:02:53 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:54 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-271944312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4fd1bb-694b-4f03-b468-b9c7ec9711a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:52Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Creating volume cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052e7dd-1f0c-4afc-94ef-d13010d89663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cf31e5-73f9-4dc2-9c87-2750387d1547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:54 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 1073741824 Nov 02 11:02:54 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Volume volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 (55a8cee1-6662-410d-a41d-08ea25fc5ac2): created successfully Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cf31e5-73f9-4dc2-9c87-2750387d1547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (8fadf69f-9b5a-46fe-abf8-ccf7ac74ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b20ffba5-fd44-4d22-9383-d5f9fcc66565 tempest-CreateVolumesFromImageTest-80262407 None] Created volume successfully. Nov 02 11:02:54 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 1073741824" returned: 0 in 0.539s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:54 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 Nov 02 11:02:54 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (b4d47117-9265-4df6-b5ec-4ad040cba3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abf5965-633a-4747-824e-028fe6ede15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abf5965-633a-4747-824e-028fe6ede15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592907268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ca7b3-145d-46be-9a46-267f7be4af47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:55Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6d171b-c98e-4247-bda8-5d341a3c60b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6d171b-c98e-4247-bda8-5d341a3c60b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e4974d-7ef8-4014-b90d-77269513b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e4974d-7ef8-4014-b90d-77269513b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39ca7b3-145d-46be-9a46-267f7be4af47', 'volume_name': 'volume-e39ca7b3-145d-46be-9a46-267f7be4af47', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98a29b8-4525-4ccf-9dac-1f184cf99643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98a29b8-4525-4ccf-9dac-1f184cf99643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c18405-4c91-4da0-a6f0-8efe656200cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume e39ca7b3-145d-46be-9a46-267f7be4af47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39ca7b3-145d-46be-9a46-267f7be4af47', 'volume_size': 1} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.488s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808760726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b62fff-4aa9-485b-aa88-80e6fb50a1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:52Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Creating volume c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363f108-1718-4d82-9fb4-8e1eba70ff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538f008e-973d-4185-8f52-1e13ccd3a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Volume volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 (cd4fd1bb-694b-4f03-b468-b9c7ec9711a0): created successfully Nov 02 11:02:55 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 1073741824 Nov 02 11:02:55 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538f008e-973d-4185-8f52-1e13ccd3a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (74cd0cc8-067c-4267-8818-9b606311505f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-be4b3424-6dc3-4d0c-ac57-71dfb84b146b tempest-CreateVolumesFromImageTest-80262407 None] Created volume successfully. Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (75bab1f6-7fad-4395-8398-5fb1671ad469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0df9d9-203f-4478-a2c1-b8102e74cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0df9d9-203f-4478-a2c1-b8102e74cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305279864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff10471-5f54-44ef-ac25-930f10dd024f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:55Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7b5ed4-5070-4eed-a505-f3d4fa8e44bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7b5ed4-5070-4eed-a505-f3d4fa8e44bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34e7ab-4b07-4d66-bbb6-3c92e4650666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34e7ab-4b07-4d66-bbb6-3c92e4650666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff10471-5f54-44ef-ac25-930f10dd024f', 'volume_name': 'volume-bff10471-5f54-44ef-ac25-930f10dd024f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c99c586-ac2c-4dee-a15f-dece58605ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c99c586-ac2c-4dee-a15f-dece58605ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048d582d-659b-40f3-9d62-79282406b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume bff10471-5f54-44ef-ac25-930f10dd024f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff10471-5f54-44ef-ac25-930f10dd024f', 'volume_size': 1} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 1073741824" returned: 0 in 0.609s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:55 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 Nov 02 11:02:55 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Flow 'volume_create_manager' (bb8d9e75-a56e-43fc-ac36-e590d13417e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b784737-4550-45d6-959a-88b96cf7de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b784737-4550-45d6-959a-88b96cf7de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795db09-9645-48ea-beea-f22914f25aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d93dc9ade2a49f48aa935408991d104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='60933c0ff3c248099d61008da025c63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772efd92-7590-4872-ab58-33accb3311ef),volume_type_id=772efd92-7590-4872-ab58-33accb3311ef)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb6b9a-c415-48b1-a358-0306571491ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eeb6b9a-c415-48b1-a358-0306571491ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be38a590-bf06-4aef-942e-717fa7565963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:02:56 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.180s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577922762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e3524c-a0fe-468a-bc72-5bc2bcb69a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:53Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Creating volume 80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:56 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 1073741824 Nov 02 11:02:56 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (5a34c68a-f269-404e-ad5e-4ffe04d73ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007df01-a08c-4f34-bd94-bb27d1e18008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3fa006-c2cb-4296-a89d-8896f851f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a73c1-b7ee-4807-a694-f6a9f36ed691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007df01-a08c-4f34-bd94-bb27d1e18008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844354438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5b639a-2edc-4cf4-bbc0-04b94c883f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66263bd-289c-451d-a0a7-61ac65170dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66263bd-289c-451d-a0a7-61ac65170dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a774fab9-55ef-4a82-9c62-41e8a93d21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a774fab9-55ef-4a82-9c62-41e8a93d21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5b639a-2edc-4cf4-bbc0-04b94c883f7e', 'volume_name': 'volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e19b3-b185-4daf-8b65-0e2111b19c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65e19b3-b185-4daf-8b65-0e2111b19c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd31f665-7dde-4110-9f48-0eca7cdea34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume 3d5b639a-2edc-4cf4-bbc0-04b94c883f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e', 'volume_size': 1} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Volume volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 (c9b62fff-4aa9-485b-aa88-80e6fb50a1b2): created successfully Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a73c1-b7ee-4807-a694-f6a9f36ed691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (c352f44c-2d69-4195-b863-d256f7cf3501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-01d2cfe0-6cbc-4741-ac60-73e44c0949f8 tempest-CreateVolumesFromImageTest-80262407 None] Created volume successfully. Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (fc4bd0d3-d843-4804-8d35-a7d14ebad639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151005a-8264-4ff9-9ec4-c9ea3c23df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1151005a-8264-4ff9-9ec4-c9ea3c23df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429322850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e818a33b-d9d6-41ca-be78-93d219a83b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef5cfe-42c0-46bd-acb1-0b04107db505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef5cfe-42c0-46bd-acb1-0b04107db505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6fcf60-1f4c-4f7b-a29b-6ef5316e4de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6fcf60-1f4c-4f7b-a29b-6ef5316e4de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e818a33b-d9d6-41ca-be78-93d219a83b21', 'volume_name': 'volume-e818a33b-d9d6-41ca-be78-93d219a83b21', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab064fe-03c8-4ba9-98ff-dc296ba1d72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab064fe-03c8-4ba9-98ff-dc296ba1d72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd675ac-8121-4251-a011-a51e1274078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume e818a33b-d9d6-41ca-be78-93d219a83b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e818a33b-d9d6-41ca-be78-93d219a83b21', 'volume_size': 1} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be38a590-bf06-4aef-942e-717fa7565963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e795db09-9645-48ea-beea-f22914f25aff', 'volume_name': 'volume-e795db09-9645-48ea-beea-f22914f25aff', 'volume_size': 1, 'image_id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc7dd8263778f9057a882ed53ebfe74e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d93dc9ade2a49f48aa935408991d104', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f55155b246247031c2f52501106172bb414821f0854019af7fa707e4ac116776d29800e62fc4427176eae08754314e9ba1c652c2fb3890a1b3727ca20685e60', 'id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'created_at': datetime.datetime(2026, 11, 2, 10, 2, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48fd36d-023d-44f3-9309-73432293cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48fd36d-023d-44f3-9309-73432293cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554365a2-29f9-4e65-81b7-f72f852eb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Volume e795db09-9645-48ea-beea-f22914f25aff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e795db09-9645-48ea-beea-f22914f25aff', 'volume_size': 1, 'image_id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc7dd8263778f9057a882ed53ebfe74e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d93dc9ade2a49f48aa935408991d104', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f55155b246247031c2f52501106172bb414821f0854019af7fa707e4ac116776d29800e62fc4427176eae08754314e9ba1c652c2fb3890a1b3727ca20685e60', 'id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'created_at': datetime.datetime(2026, 11, 2, 10, 2, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 11:02:56 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Trying to clone e795db09-9645-48ea-beea-f22914f25aff from image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 1073741824" returned: 0 in 0.519s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:56 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 Nov 02 11:02:56 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (c2a7d443-0842-42d2-81b6-26da31f64be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118a989-30ae-4947-bb0b-204d17016b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118a989-30ae-4947-bb0b-204d17016b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251837342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b8bda0-f334-412b-bdc2-97963e970b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:57Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9790d030-6c90-474e-a61c-1f34425bf06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9790d030-6c90-474e-a61c-1f34425bf06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090b3ad-7801-4215-853c-e88ab6707cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090b3ad-7801-4215-853c-e88ab6707cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b8bda0-f334-412b-bdc2-97963e970b62', 'volume_name': 'volume-12b8bda0-f334-412b-bdc2-97963e970b62', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f733c655-d21c-4f85-acfc-38bd17d9ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f733c655-d21c-4f85-acfc-38bd17d9ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd412f4-62b9-41ad-bd77-db040aa3f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume 12b8bda0-f334-412b-bdc2-97963e970b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b8bda0-f334-412b-bdc2-97963e970b62', 'volume_size': 1} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e3a45-b1ce-4f8a-862f-d8850e6d9fa3]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:56 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.854s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-943084505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22689091-53f8-4470-aa31-b39d14a6bde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c524903f58aa47f8955c4b759fbe4fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:53Z,use_quota=True,user_id='1cff05f529404c108af2754151a7f294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Creating volume 22689091-53f8-4470-aa31-b39d14a6bde1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:56 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:02:56 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7617ee-2cb1-4e45-9810-3b060af6c05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424cb856-1968-4934-8905-efd6e1716f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:56 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 1073741824 Nov 02 11:02:56 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Volume volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 (80e3524c-a0fe-468a-bc72-5bc2bcb69a10): created successfully Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424cb856-1968-4934-8905-efd6e1716f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (89058eb7-f238-4bc3-a808-7968b36267c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5963ab85-15ea-4d82-9f7a-04697e8f312f tempest-ProjectReaderTests-1133394238 None] Created volume successfully. Nov 02 11:02:57 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:57 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:02:57 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:57 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 1073741824" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:57 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 Nov 02 11:02:57 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:57 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Temporary image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 is fetched for user 60933c0ff3c248099d61008da025c63b. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d21e9-2a24-4f1e-b3fd-ac9e14b445cd]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:57 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592907268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39ca7b3-145d-46be-9a46-267f7be4af47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:55Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume e39ca7b3-145d-46be-9a46-267f7be4af47 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:57 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87fbd7f-72f2-45e9-9d90-075097dc17a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22689091-53f8-4470-aa31-b39d14a6bde1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea8cc2c-6d16-46d1-841e-c625ecb3c15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:57 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 1073741824 Nov 02 11:02:57 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:57 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:02:57 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Volume volume-22689091-53f8-4470-aa31-b39d14a6bde1 (22689091-53f8-4470-aa31-b39d14a6bde1): created successfully Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea8cc2c-6d16-46d1-841e-c625ecb3c15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Flow 'volume_create_manager' (58fdf8b6-83fa-4c91-90a2-c570e431508b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bd9fce94-0e2b-4e2d-8ad4-baf6fd3f8477 tempest-CreateVolumesFromImageTest-80262407 None] Created volume successfully. Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-22689091-53f8-4470-aa31-b39d14a6bde1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-22689091-53f8-4470-aa31-b39d14a6bde1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-quobyte-22689091-53f8-4470-aa31-b39d14a6bde1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:57 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-22689091-53f8-4470-aa31-b39d14a6bde1" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a294fa9-b681-4c65-9070-74663f3ab6c2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:58 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:58 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:58 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 Nov 02 11:02:58 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:58 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 1073741824" returned: 0 in 0.587s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:58 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 Nov 02 11:02:58 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:58 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:58 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:58 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1 Nov 02 11:02:58 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:58 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.822s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305279864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff10471-5f54-44ef-ac25-930f10dd024f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:55Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume bff10471-5f54-44ef-ac25-930f10dd024f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:58 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c18405-4c91-4da0-a6f0-8efe656200cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39ca7b3-145d-46be-9a46-267f7be4af47', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:58 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f 1073741824 Nov 02 11:02:58 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8210686e-db50-42d0-8140-f30922932c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-e39ca7b3-145d-46be-9a46-267f7be4af47 (e39ca7b3-145d-46be-9a46-267f7be4af47): created successfully Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8210686e-db50-42d0-8140-f30922932c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (b4d47117-9265-4df6-b5ec-4ad040cba3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-21a1f3d7-80f2-44e1-970f-34cfe577a8e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:02:58 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-22689091-53f8-4470-aa31-b39d14a6bde1" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-22689091-53f8-4470-aa31-b39d14a6bde1" released by "delete_volume" :: held 0.756s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Created reservations ['58e10895-1d22-404f-a586-e45a9cba4a52', '8d0b1c8a-bac7-4bce-afb5-8bc1d24ae9eb', 'ece0a503-9054-469d-8157-af3092ec5002', 'd9bba64b-f26f-46fe-aec8-894411f08d82'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:59 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:02:59 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:59 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f 1073741824" returned: 0 in 0.594s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-quobyte-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f61660-d96a-4401-8841-72ae81efcf34]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:59 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f Nov 02 11:02:59 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:59 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 Nov 02 11:02:59 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:59 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:02:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Deleted volume successfully. Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-380feef6-003a-4626-80cf-b92230eced59 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-22689091-53f8-4470-aa31-b39d14a6bde1-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:59 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844354438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5b639a-2edc-4cf4-bbc0-04b94c883f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume 3d5b639a-2edc-4cf4-bbc0-04b94c883f7e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:02:59 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:59 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e 1073741824 Nov 02 11:02:59 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048d582d-659b-40f3-9d62-79282406b523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff10471-5f54-44ef-ac25-930f10dd024f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b430c33e-369c-44ba-9ef2-d05b43ec808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:02:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-bff10471-5f54-44ef-ac25-930f10dd024f (bff10471-5f54-44ef-ac25-930f10dd024f): created successfully Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b430c33e-369c-44ba-9ef2-d05b43ec808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (75bab1f6-7fad-4395-8398-5fb1671ad469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:02:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-af5a3ef8-ba8f-4a29-8a76-7ee9e44db704 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:02:59 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:02:59 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2 Nov 02 11:02:59 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:02:59 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2" released by "delete_volume" :: held 0.755s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:02:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Created reservations ['48f578b8-4e9b-4a63-b137-93890dcdd157', '05e1a593-16d3-4e64-b1ad-b488fce868c9', '0f8fb4c0-c06c-4477-966f-b5215a2e40b6', '30b44e19-1124-4325-9579-2aa4a43e9cb2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:02:59 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e 1073741824" returned: 0 in 0.503s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:00 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:00 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e Nov 02 11:03:00 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:00 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Deleted volume successfully. Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-quobyte-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-54e2c2ef-71c7-43a7-8dae-0c4df9f91d23 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-c9b62fff-4aa9-485b-aa88-80e6fb50a1b2-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:00 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.917s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1429322850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e818a33b-d9d6-41ca-be78-93d219a83b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume e818a33b-d9d6-41ca-be78-93d219a83b21 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:00 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:00 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 1073741824 Nov 02 11:03:00 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd31f665-7dde-4110-9f48-0eca7cdea34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c41db44-4a4a-44b3-a0dd-d39dde624519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[326c01cd-3c6b-425c-b155-1b1918730ce4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e (3d5b639a-2edc-4cf4-bbc0-04b94c883f7e): created successfully Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c41db44-4a4a-44b3-a0dd-d39dde624519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (5a34c68a-f269-404e-ad5e-4ffe04d73ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e717516f-a554-49c1-8dbc-a4d371cefff4 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:03:00 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 Nov 02 11:03:00 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:00 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:00 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0 Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 1073741824" returned: 0 in 0.455s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:00 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:00 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 Nov 02 11:03:00 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:01 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0" released by "delete_volume" :: held 0.690s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:01 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.308s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1251837342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b8bda0-f334-412b-bdc2-97963e970b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0faf57f8c248dd87c46de4e69b3535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:57Z,use_quota=True,user_id='75e80dad9db14844870eba8d4c9a83f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Creating volume 12b8bda0-f334-412b-bdc2-97963e970b62 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:01 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 1073741824 Nov 02 11:03:01 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd675ac-8121-4251-a011-a51e1274078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e818a33b-d9d6-41ca-be78-93d219a83b21', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eff1681-f32b-4692-94a3-0f14227f1b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Created reservations ['71094aec-e045-4559-8bb3-03df1eaa5599', '6ea91f85-71de-496e-b0b1-69ba9dbb1df5', 'd47780c6-8c9f-4846-88e8-0893c93f1015', 'cd1a49b6-29b9-4ecf-b42c-a640441aed71'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-e818a33b-d9d6-41ca-be78-93d219a83b21 (e818a33b-d9d6-41ca-be78-93d219a83b21): created successfully Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eff1681-f32b-4692-94a3-0f14227f1b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (fc4bd0d3-d843-4804-8d35-a7d14ebad639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba27bcbf-eb26-42ca-a4c9-5859598f40e7 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:01 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:01 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-55a8cee1-6662-410d-a41d-08ea25fc5ac2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-55a8cee1-6662-410d-a41d-08ea25fc5ac2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-quobyte-55a8cee1-6662-410d-a41d-08ea25fc5ac2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-55a8cee1-6662-410d-a41d-08ea25fc5ac2" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:01 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Deleted volume successfully. Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb924ec-34b9-4cc9-be78-b83de41ddd4f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8c7b1ac1-0023-4a6f-9b33-c240ce7fee2c tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-cd4fd1bb-694b-4f03-b468-b9c7ec9711a0-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:01 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 1073741824" returned: 0 in 0.512s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:01 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 Nov 02 11:03:01 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:01 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 Nov 02 11:03:01 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:01 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.751s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd412f4-62b9-41ad-bd77-db040aa3f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b8bda0-f334-412b-bdc2-97963e970b62', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1dc4feb-ace9-4f47-bdf9-b65050e34b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Creating offline snapshot 0a7368a1-7076-4750-9327-993f0aa55585 of volume 80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:01 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Volume volume-12b8bda0-f334-412b-bdc2-97963e970b62 (12b8bda0-f334-412b-bdc2-97963e970b62): created successfully Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1dc4feb-ace9-4f47-bdf9-b65050e34b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Flow 'volume_create_manager' (c2a7d443-0842-42d2-81b6-26da31f64be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3b2706-a6bf-40e5-a3d3-6558e7f7551e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b4a9fc97-738c-4a0a-aa06-5748e0485515 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created volume successfully. Nov 02 11:03:02 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2 Nov 02 11:03:02 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 Nov 02 11:03:02 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-12b8bda0-f334-412b-bdc2-97963e970b62-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-12b8bda0-f334-412b-bdc2-97963e970b62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-12b8bda0-f334-412b-bdc2-97963e970b62" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-12b8bda0-f334-412b-bdc2-97963e970b62" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:02 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-55a8cee1-6662-410d-a41d-08ea25fc5ac2" returned: 0 in 0.331s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d605fa-1ab2-4ccf-a29b-fc7cb687ef3a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-55a8cee1-6662-410d-a41d-08ea25fc5ac2" released by "delete_volume" :: held 0.813s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:02 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Created reservations ['f76b4729-73f2-4afe-a107-70cb67e6d1dc', 'b6dbd09c-01e5-4e99-b7e5-c31d80fc0b4f', '719fe82a-e784-4ade-b630-fa501c9ce21e', 'be356c4e-44ff-4b22-b98b-d9a8cb7191c5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:02 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 1G Nov 02 11:03:02 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 Nov 02 11:03:02 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:02 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-c7806c9e-ba67-4566-986d-42e35af3dd9a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-c7806c9e-ba67-4566-986d-42e35af3dd9a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "cinder-quobyte-c7806c9e-ba67-4566-986d-42e35af3dd9a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-c7806c9e-ba67-4566-986d-42e35af3dd9a" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:02 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdeb14-e721-427b-a63d-312bf11c9838]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:02 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62 Nov 02 11:03:02 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Deleted volume successfully. Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34457b0c-9043-4234-877a-4bb121a66b96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-55a8cee1-6662-410d-a41d-08ea25fc5ac2-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:02 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 1G" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:02 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 Nov 02 11:03:02 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:02 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a Nov 02 11:03:02 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-12b8bda0-f334-412b-bdc2-97963e970b62" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-12b8bda0-f334-412b-bdc2-97963e970b62" released by "delete_volume" :: held 0.774s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['ee9bdae8-5910-47d8-8211-51a8982776b3', 'b4f38bf6-7d8e-497d-8825-8002c5c19e91', 'b71cd830-0bcb-4a46-86b4-b7b53459d3ed', '215a1a10-97cf-4cca-acbd-bc664058f17d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:03 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 is being set with open permissions: ugo+rw Nov 02 11:03:03 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 Nov 02 11:03:03 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:03 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a Nov 02 11:03:03 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-e818a33b-d9d6-41ca-be78-93d219a83b21-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-e818a33b-d9d6-41ca-be78-93d219a83b21-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-e818a33b-d9d6-41ca-be78-93d219a83b21" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:03 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-e818a33b-d9d6-41ca-be78-93d219a83b21" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:03 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b05931-a6a3-4f73-8c65-a1dbf29fb516]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info Nov 02 11:03:03 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c7806c9e-ba67-4566-986d-42e35af3dd9a" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-quobyte-c7806c9e-ba67-4566-986d-42e35af3dd9a" released by "delete_volume" :: held 0.845s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a558f346-70b0-4ff1-8c7c-488f47880919 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-12b8bda0-f334-412b-bdc2-97963e970b62-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Created reservations ['133ff325-ffb6-495a-8de5-c7719283b17b', '2c83a2fa-f0d8-403d-97f7-5fed71fb94a5', '4b07c11d-2ac8-47a9-aa96-69827bc22385', 'bc7efa02-5b7f-4e82-a8b6-b1bbf0df0121'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:03 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 Nov 02 11:03:03 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:03 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info is being set with open permissions: ugo+rw Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:03 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info Nov 02 11:03:03 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:03 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:04 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21 Nov 02 11:03:04 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:04 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Deleted volume successfully. Nov 02 11:03:04 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4e659044-054b-4d56-bdf8-a3cab8159d96 tempest-CreateVolumesFromImageTest-80262407 None] Lock "cinder-c7806c9e-ba67-4566-986d-42e35af3dd9a-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.info" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.735s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795db09-9645-48ea-beea-f22914f25aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d93dc9ade2a49f48aa935408991d104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:02:56Z,use_quota=True,user_id='60933c0ff3c248099d61008da025c63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(772efd92-7590-4872-ab58-33accb3311ef),volume_type_id=772efd92-7590-4872-ab58-33accb3311ef)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Creating volume e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:04 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1073741824 Nov 02 11:03:04 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c57f89a8-e7ff-438b-89c6-5356954b95e9 tempest-ProjectReaderTests-1133394238 None] Create snapshot completed successfully Nov 02 11:03:04 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e818a33b-d9d6-41ca-be78-93d219a83b21" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-e818a33b-d9d6-41ca-be78-93d219a83b21" released by "delete_volume" :: held 0.818s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['7b6e642a-5dc5-4075-a946-a02fb550442a', 'f5768bac-f54c-4251-835f-3df8971b588e', '7cdd2e0f-bf06-4008-a2ba-3aecceb46eb8', '6e1d570e-fef5-41a4-a0cf-78c6d68663c1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:04 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:04 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:04 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1073741824" returned: 0 in 0.688s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f43986a-bb94-464b-ab32-f5c2903fe1ec]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:04 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:04 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:04 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff Nov 02 11:03:04 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d58da9b2-11bf-45c1-8e29-692df55b6e0e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-e818a33b-d9d6-41ca-be78-93d219a83b21-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:05 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e Nov 02 11:03:05 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-0a7368a1-7076-4750-9327-993f0aa55585-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-0a7368a1-7076-4750-9327-993f0aa55585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-0a7368a1-7076-4750-9327-993f0aa55585" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-0a7368a1-7076-4750-9327-993f0aa55585" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Deleting offline snapshot 0a7368a1-7076-4750-9327-993f0aa55585 of volume 80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] snapshot_file for this snap is: volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f835af2-6c04-4a3f-89cb-c12d65c73d0a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:05 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Attempting download of 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}])) to volume e795db09-9645-48ea-beea-f22914f25aff. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 11:03:05 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 Nov 02 11:03:05 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0bda18-a580-43bc-b5a6-e56c41b77e3b]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:05 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" returned: 0 in 0.647s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:05 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e Nov 02 11:03:05 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq Nov 02 11:03:05 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c3f9d-b20a-495a-af7d-baccfeaebed0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:05 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e" released by "delete_volume" :: held 1.143s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:05 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 Nov 02 11:03:05 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:05 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq" returned: 0 in 0.499s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['c08fc34f-24a1-4cfe-9f8f-a1d87c3c2a77', '2e7ee76b-24d2-4ebc-b56e-b317f5f7141d', '4005b25e-f85d-44e6-b2ea-463dd377be8b', '27718058-80cb-41ea-b9d4-cd46bba3ebc8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq Nov 02 11:03:06 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:06 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 Nov 02 11:03:06 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq" returned: 1 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_qm4qd7bq' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:06 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7758fe6-31f6-4c1e-9194-84198f7e0a0c]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7b075a4-1787-4770-b478-7acf04f02fb3 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-3d5b639a-2edc-4cf4-bbc0-04b94c883f7e-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:06 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:03:06 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585 Nov 02 11:03:06 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:06 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD Nov 02 11:03:06 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:06 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10.0a7368a1-7076-4750-9327-993f0aa55585" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-0a7368a1-7076-4750-9327-993f0aa55585" released by "_delete_snapshot" :: held 1.759s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" released by "delete_snapshot" :: held 1.799s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-bff10471-5f54-44ef-ac25-930f10dd024f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-bff10471-5f54-44ef-ac25-930f10dd024f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-bff10471-5f54-44ef-ac25-930f10dd024f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:07 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-bff10471-5f54-44ef-ac25-930f10dd024f" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e382a85-46ec-4176-b8a0-aa6bc4fe11d5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Created reservations ['d630be7c-c837-4182-b576-e2b87b7c9ddf', 'e2d22034-d897-46e8-8a09-e97270120721', '9e595e4b-8e51-42cd-8197-c1eedff5a0cf', 'b48109f7-f559-40f5-ae3d-8972d1c068f3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:07 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff Nov 02 11:03:07 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Delete snapshot completed successfully. Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cb7d3ec5-97bd-4a09-a1f6-621277cc2633 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-0a7368a1-7076-4750-9327-993f0aa55585-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:07 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f Nov 02 11:03:07 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (4c39a3a5-0ea7-41e1-9647-3a37563c8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade147dd-1bbd-4341-9aaf-c3124415c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:07 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:07 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade147dd-1bbd-4341-9aaf-c3124415c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803544001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63634cdb-d268-43a2-aa96-91452c666e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:08Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:07 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5456d0a1-ec52-4be3-8483-1ef25272b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:07 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5456d0a1-ec52-4be3-8483-1ef25272b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325ba5ca-d70f-46cc-b448-5a368933b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325ba5ca-d70f-46cc-b448-5a368933b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63634cdb-d268-43a2-aa96-91452c666e21', 'volume_name': 'volume-63634cdb-d268-43a2-aa96-91452c666e21', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb07644-f3c7-46b4-944e-be6b5e2b980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb07644-f3c7-46b4-944e-be6b5e2b980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5ee298-2f0a-4f5d-9481-f8c5bc502f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume 63634cdb-d268-43a2-aa96-91452c666e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63634cdb-d268-43a2-aa96-91452c666e21', 'volume_size': 1} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803544001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63634cdb-d268-43a2-aa96-91452c666e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:08Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume 63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff" returned: 0 in 0.586s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9_xu68f81xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:03:07 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:07 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 1073741824 Nov 02 11:03:07 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:07 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1G Nov 02 11:03:07 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:07 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-bff10471-5f54-44ef-ac25-930f10dd024f" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-bff10471-5f54-44ef-ac25-930f10dd024f" released by "delete_volume" :: held 0.794s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['010b4edb-efab-439b-805d-89ca8766d6eb', '811d72fd-5908-4108-b275-d25d62e40e71', '8406fc97-d7cb-48b8-8779-8a3fbb09e4c9', 'e9962fed-212e-45f4-9917-b072a1828f60'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:08 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:08 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:08 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff 1G" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Downloaded image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}])) to volume e795db09-9645-48ea-beea-f22914f25aff successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Temporary image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 for user 60933c0ff3c248099d61008da025c63b is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Marking volume e795db09-9645-48ea-beea-f22914f25aff as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Copying metadata from image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 to e795db09-9645-48ea-beea-f22914f25aff. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Creating volume glance metadata for volume e795db09-9645-48ea-beea-f22914f25aff backed by image 1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dc7dd8263778f9057a882ed53ebfe74e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554365a2-29f9-4e65-81b7-f72f852eb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e795db09-9645-48ea-beea-f22914f25aff', 'volume_size': 1, 'image_id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dc7dd8263778f9057a882ed53ebfe74e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d93dc9ade2a49f48aa935408991d104', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f55155b246247031c2f52501106172bb414821f0854019af7fa707e4ac116776d29800e62fc4427176eae08754314e9ba1c652c2fb3890a1b3727ca20685e60', 'id': '1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9', 'created_at': datetime.datetime(2026, 11, 2, 10, 2, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 2, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d6048bb-2d81-4cdb-aedd-b7a8f5de34e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c72ff-25ea-4395-80ea-aaa31479f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:08 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-e39ca7b3-145d-46be-9a46-267f7be4af47-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 1073741824" returned: 0 in 0.520s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Volume volume-e795db09-9645-48ea-beea-f22914f25aff (e795db09-9645-48ea-beea-f22914f25aff): created successfully Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54c72ff-25ea-4395-80ea-aaa31479f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Flow 'volume_create_manager' (bb8d9e75-a56e-43fc-ac36-e590d13417e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-e39ca7b3-145d-46be-9a46-267f7be4af47-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1de657b4-b09c-46b7-b765-5cc927032700 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Created volume successfully. Nov 02 11:03:08 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 Nov 02 11:03:08 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:08 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-e39ca7b3-145d-46be-9a46-267f7be4af47" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-e39ca7b3-145d-46be-9a46-267f7be4af47" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-80e3524c-a0fe-468a-bc72-5bc2bcb69a10-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-80e3524c-a0fe-468a-bc72-5bc2bcb69a10-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2b1976e5-23b6-4d8e-ae6a-0c127aff1e6e tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-bff10471-5f54-44ef-ac25-930f10dd024f-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a85b5-b745-43e6-a152-b4cd2fb36d37]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a982127-1967-49b2-9ed3-aaf4460f0bb8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:08 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 Nov 02 11:03:08 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Acquiring lock "cinder-e795db09-9645-48ea-beea-f22914f25aff-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "cinder-e795db09-9645-48ea-beea-f22914f25aff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Acquiring lock "cinder-quobyte-e795db09-9645-48ea-beea-f22914f25aff" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5ee298-2f0a-4f5d-9481-f8c5bc502f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63634cdb-d268-43a2-aa96-91452c666e21', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42317c8-6545-4ae7-9403-3fde088b3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "cinder-quobyte-e795db09-9645-48ea-beea-f22914f25aff" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-63634cdb-d268-43a2-aa96-91452c666e21 (63634cdb-d268-43a2-aa96-91452c666e21): created successfully Nov 02 11:03:08 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 Nov 02 11:03:08 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42317c8-6545-4ae7-9403-3fde088b3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (4c39a3a5-0ea7-41e1-9647-3a37563c8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87013eb-861c-4ec9-aea1-6e25357abda8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5b3ae536-1ba6-4224-946e-65cb747532d1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:08 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff Nov 02 11:03:08 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47 Nov 02 11:03:09 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10 Nov 02 11:03:09 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff Nov 02 11:03:09 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e39ca7b3-145d-46be-9a46-267f7be4af47" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-e39ca7b3-145d-46be-9a46-267f7be4af47" released by "delete_volume" :: held 0.929s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:09 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-80e3524c-a0fe-468a-bc72-5bc2bcb69a10" released by "delete_volume" :: held 0.864s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['7d7e465c-d141-4355-a7b5-a07d234546dc', '680e1c34-0202-485b-b34c-4e6730d40fb2', '68ebfbc4-03f7-4e57-8db0-75a1ce485fa1', 'c73eb697-de82-4166-a38d-089f67e73835'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Created reservations ['4f02e585-8957-4d14-baf7-3b66a52e921c', 'ec189c01-2f8d-4faa-995d-316e919b1c5b', 'b7c12cb2-0864-44fe-af69-4192856261c5', '9de93051-52c7-4e96-bfce-9b6ed909396a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:09 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e795db09-9645-48ea-beea-f22914f25aff" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:09 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "cinder-quobyte-e795db09-9645-48ea-beea-f22914f25aff" released by "delete_volume" :: held 0.802s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:09 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:09 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Created reservations ['2de16c10-f880-43ed-a17f-84cc9a3abfba', 'b5a56251-8b85-48ca-8b33-c94964d5b0f2', '1d1bbae0-3193-4f8d-ad6c-cca4c9be2465', '2eb9d64f-eae5-4b75-9eab-6e33532654b0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:09 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bca45ee2-4562-4a7b-aa9f-9e9535e5c8f6 tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-e39ca7b3-145d-46be-9a46-267f7be4af47-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:09 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:09 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:10 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:03:10 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Deleted volume successfully. Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd16c596-29e9-460e-a2ec-4df677556e44 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-80e3524c-a0fe-468a-bc72-5bc2bcb69a10-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:10 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Deleted volume successfully. Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-616797ff-f14b-423a-ad4c-dd6ac354a147 tempest-VolumeAndVolumeTypeFromImageTest-242163130 None] Lock "cinder-e795db09-9645-48ea-beea-f22914f25aff-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-3784342f-bd1c-4e52-a603-e19ecd244f50-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating offline snapshot cea237b7-198f-442d-a018-c54bd927bccd of volume 63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-3784342f-bd1c-4e52-a603-e19ecd244f50-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (04028190-159c-4438-83f6-9d131b84902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52db160a-80e5-4b83-9b52-897d6e60c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b739c8a-ddbb-468e-abe4-ea0bc16cc67c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52db160a-80e5-4b83-9b52-897d6e60c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625912733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c46d6e9-6e36-421b-b761-f25e0f4890e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:11Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14621c5a-3add-42d1-aa90-513c62b1d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14621c5a-3add-42d1-aa90-513c62b1d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb874e39-22d0-4424-922f-aea56ce088ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb874e39-22d0-4424-922f-aea56ce088ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c46d6e9-6e36-421b-b761-f25e0f4890e3', 'volume_name': 'volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2973ce1a-4add-428f-9656-8a912eeea668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2973ce1a-4add-428f-9656-8a912eeea668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b755a9-374a-4381-ab4e-717bcdcda730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Volume 5c46d6e9-6e36-421b-b761-f25e0f4890e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3', 'volume_size': 1} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "cinder-quobyte-3784342f-bd1c-4e52-a603-e19ecd244f50" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-3784342f-bd1c-4e52-a603-e19ecd244f50" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:10 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 Nov 02 11:03:10 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb213bc-ee2d-4391-ae57-63b415648f88]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:10 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 Nov 02 11:03:10 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:11 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:11 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd 1G Nov 02 11:03:11 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:11 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:11 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50 Nov 02 11:03:11 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:11 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3784342f-bd1c-4e52-a603-e19ecd244f50" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-quobyte-3784342f-bd1c-4e52-a603-e19ecd244f50" released by "delete_volume" :: held 0.727s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:11 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd 1G" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63634cdb-d268-43a2-aa96-91452c666e21 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Created reservations ['d7af0abd-72eb-46fd-a561-bf4edf0ef6df', 'ffced3f3-9a2c-43ca-9e81-7ee11b8e84f3', 'e063ad07-17bc-417e-aadb-8abb41086de7', '8fae9f5f-d8c5-4152-9d3f-c60838685114'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:11 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63634cdb-d268-43a2-aa96-91452c666e21 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd Nov 02 11:03:11 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:11 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:11 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:11 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63634cdb-d268-43a2-aa96-91452c666e21 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:11 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd is being set with open permissions: ugo+rw Nov 02 11:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:11 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Deleted volume successfully. Nov 02 11:03:12 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd Nov 02 11:03:12 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d48d0d7-b26d-40f0-94d8-42aff24c07ad tempest-CreateVolumesFromSourceVolumeTest-1663927205 None] Lock "cinder-3784342f-bd1c-4e52-a603-e19ecd244f50-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:12 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:12 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info Nov 02 11:03:12 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:12 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:12 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info is being set with open permissions: ugo+rw Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:12 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info Nov 02 11:03:12 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:12 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.info" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.162s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625912733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c46d6e9-6e36-421b-b761-f25e0f4890e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:11Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Creating volume 5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:12 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:12 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 1073741824 Nov 02 11:03:12 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3d42aae7-9d2d-4e38-89da-7670fb6296b1 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Create snapshot completed successfully Nov 02 11:03:13 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 1073741824" returned: 0 in 0.586s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:13 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 Nov 02 11:03:13 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:13 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b755a9-374a-4381-ab4e-717bcdcda730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bb4f6-1634-4dd6-9bc1-f338cb04ec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ebbc22ec-25c5-40f0-9c80-d72610202d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20360414-b0b4-41dc-8965-7d642cd57252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Volume volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 (5c46d6e9-6e36-421b-b761-f25e0f4890e3): created successfully Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029bb4f6-1634-4dd6-9bc1-f338cb04ec9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (04028190-159c-4438-83f6-9d131b84902d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20360414-b0b4-41dc-8965-7d642cd57252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445350470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f81cac-eeb6-4417-915e-22690575687c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:14Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277eed99-807f-4ffa-a8bc-cd66df580b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277eed99-807f-4ffa-a8bc-cd66df580b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc14871-84bf-4605-8292-a4a6d8fba941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc14871-84bf-4605-8292-a4a6d8fba941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f81cac-eeb6-4417-915e-22690575687c', 'volume_name': 'volume-58f81cac-eeb6-4417-915e-22690575687c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4d774d-83b5-4a15-8b0e-bd9bfb0664b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4d774d-83b5-4a15-8b0e-bd9bfb0664b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c82b68b-dd97-4368-8e8e-681b8ca49a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume 58f81cac-eeb6-4417-915e-22690575687c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f81cac-eeb6-4417-915e-22690575687c', 'volume_size': 1} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1445350470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f81cac-eeb6-4417-915e-22690575687c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:14Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume 58f81cac-eeb6-4417-915e-22690575687c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-214402e0-c074-4505-b545-c3063d8ec1dc tempest-ProjectReaderTests-1133394238 None] Created volume successfully. Nov 02 11:03:14 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c 1073741824 Nov 02 11:03:14 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ddca0033-bf19-4b89-ab8c-5c5de4b5f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b521bf8e-0f09-482c-aa30-547b5bf08026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b521bf8e-0f09-482c-aa30-547b5bf08026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562232604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3588127-2ec0-45dd-8f46-2d73386083bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:15Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c4cebf-f466-49bf-b3fb-74b7c4382645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80c4cebf-f466-49bf-b3fb-74b7c4382645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7f46ff-699b-4614-8d35-94981e23488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7f46ff-699b-4614-8d35-94981e23488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3588127-2ec0-45dd-8f46-2d73386083bc', 'volume_name': 'volume-f3588127-2ec0-45dd-8f46-2d73386083bc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031854d0-1978-4c50-a5d7-064bf8c5115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031854d0-1978-4c50-a5d7-064bf8c5115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464ad36d-4f04-46d0-997f-82d9fbb2dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume f3588127-2ec0-45dd-8f46-2d73386083bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3588127-2ec0-45dd-8f46-2d73386083bc', 'volume_size': 1} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c 1073741824" returned: 0 in 0.737s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:15 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c Nov 02 11:03:15 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:15 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562232604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3588127-2ec0-45dd-8f46-2d73386083bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:15Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume f3588127-2ec0-45dd-8f46-2d73386083bc {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:15 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c82b68b-dd97-4368-8e8e-681b8ca49a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f81cac-eeb6-4417-915e-22690575687c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f33c3d7-8316-4875-9e41-b61f0a1fa9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc 1073741824 Nov 02 11:03:15 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-58f81cac-eeb6-4417-915e-22690575687c (58f81cac-eeb6-4417-915e-22690575687c): created successfully Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f33c3d7-8316-4875-9e41-b61f0a1fa9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ebbc22ec-25c5-40f0-9c80-d72610202d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d34ae3c7-477b-48ca-9e2e-008df2c45a98 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (7cc0a56e-c8d0-4de5-966a-d5cc27726ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b43ac2-c024-4272-8cba-140e67148130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b43ac2-c024-4272-8cba-140e67148130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-872461329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d5b38f-9df9-43d3-85c2-68c3b13fb824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:15Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afeb83b-d2a4-44cd-b9a7-b6d99fae9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afeb83b-d2a4-44cd-b9a7-b6d99fae9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b9fe52-0cf0-4846-8572-55fc1b9c2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b9fe52-0cf0-4846-8572-55fc1b9c2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d5b38f-9df9-43d3-85c2-68c3b13fb824', 'volume_name': 'volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006a9167-1a98-4ee4-9ed5-4f7188dc6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006a9167-1a98-4ee4-9ed5-4f7188dc6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f8684d-5b3c-47f4-9c65-b04cbb7e7a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume d1d5b38f-9df9-43d3-85c2-68c3b13fb824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824', 'volume_size': 1} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:15 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (15b2d7df-fc02-4479-ac31-f9e08bad80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd24d7c4-748a-46f4-aba5-ef5a1b4f9781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc 1073741824" returned: 0 in 0.665s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd24d7c4-748a-46f4-aba5-ef5a1b4f9781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200622774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ef5f0-6b73-4473-9d64-b35d08155d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82453d82-9f1f-4a70-85f6-ba0a146c46cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82453d82-9f1f-4a70-85f6-ba0a146c46cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0226a4-9564-4360-bfe3-f1218d2b7bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0226a4-9564-4360-bfe3-f1218d2b7bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091ef5f0-6b73-4473-9d64-b35d08155d9c', 'volume_name': 'volume-091ef5f0-6b73-4473-9d64-b35d08155d9c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17d204-c4a4-4f06-8e6e-fd84937f05ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17d204-c4a4-4f06-8e6e-fd84937f05ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d62e4b2-7b6d-4ea5-8170-d99a05f8c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume 091ef5f0-6b73-4473-9d64-b35d08155d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091ef5f0-6b73-4473-9d64-b35d08155d9c', 'volume_size': 1} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:16 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc Nov 02 11:03:16 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Flow 'volume_create_manager' (5c905b77-31c6-41c4-a8b0-edd8132b437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b898f7a-cc48-4f4e-a074-00ba5e2961de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b898f7a-cc48-4f4e-a074-00ba5e2961de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-528591060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30178e79-8cef-4cfb-a99d-8c4d57980b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dbc7aeed0842d194cfb3d8049e0664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='2e4135f5a9604d4c9f9ab16f454b11ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77337d1c-18c1-4fcc-8ec8-796c3ee79ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77337d1c-18c1-4fcc-8ec8-796c3ee79ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bba8fdc-4e80-4cff-82a6-fc683e615b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bba8fdc-4e80-4cff-82a6-fc683e615b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30178e79-8cef-4cfb-a99d-8c4d57980b72', 'volume_name': 'volume-30178e79-8cef-4cfb-a99d-8c4d57980b72', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090742e-6378-4e7d-8e50-bdbc6e01fdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1090742e-6378-4e7d-8e50-bdbc6e01fdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbeca16-2eb2-4bcb-ad0f-e0d09f73b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Volume 30178e79-8cef-4cfb-a99d-8c4d57980b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30178e79-8cef-4cfb-a99d-8c4d57980b72', 'volume_size': 1} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ac71981a-1064-429e-b2cd-5d9fb03fcc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:16 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24502fe-78f5-4834-9348-c500a4b5c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.413s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24502fe-78f5-4834-9348-c500a4b5c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4757125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6923794f-f924-407f-a802-19b99ab79a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87a2ef5-080a-4783-b315-8f3d4f399824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87a2ef5-080a-4783-b315-8f3d4f399824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b193ca-33e7-4487-b620-6741c9248aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b193ca-33e7-4487-b620-6741c9248aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6923794f-f924-407f-a802-19b99ab79a39', 'volume_name': 'volume-6923794f-f924-407f-a802-19b99ab79a39', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67a11f-f218-438a-8d85-09c22b49e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67a11f-f218-438a-8d85-09c22b49e873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69df7c2d-f39b-4b3d-aa2e-f02bd59a17c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume 6923794f-f924-407f-a802-19b99ab79a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6923794f-f924-407f-a802-19b99ab79a39', 'volume_size': 1} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Creating offline snapshot 416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d of volume 5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464ad36d-4f04-46d0-997f-82d9fbb2dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3588127-2ec0-45dd-8f46-2d73386083bc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6f0921-df67-4406-9d82-722a753b8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd5ef9-4c91-4805-b4e5-3da142a3f730]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-f3588127-2ec0-45dd-8f46-2d73386083bc (f3588127-2ec0-45dd-8f46-2d73386083bc): created successfully Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6f0921-df67-4406-9d82-722a753b8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ddca0033-bf19-4b89-ab8c-5c5de4b5f294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b92e41f0-1a8e-40b9-83fc-42ada0cd58f6 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:16 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 Nov 02 11:03:16 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:16 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:16 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d 1G Nov 02 11:03:16 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:17 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d 1G" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:17 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d Nov 02 11:03:17 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:17 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:17 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d is being set with open permissions: ugo+rw Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:17 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d Nov 02 11:03:17 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:17 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:17 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info Nov 02 11:03:17 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:18 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:18 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info is being set with open permissions: ugo+rw Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:18 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info Nov 02 11:03:18 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:18 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.info" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-872461329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d5b38f-9df9-43d3-85c2-68c3b13fb824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:15Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume d1d5b38f-9df9-43d3-85c2-68c3b13fb824 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:18 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:18 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 1073741824 Nov 02 11:03:18 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Flow 'volume_create_manager' (b935aa85-986d-4f05-bffc-470c1b024ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed43862-b550-4750-a283-4db0f2735ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f12b65a7-ce34-4985-8fac-d97307fb606f tempest-ProjectReaderTests-1133394238 None] Create snapshot completed successfully Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed43862-b550-4750-a283-4db0f2735ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c94ff0-3387-4f71-b188-31937ba7ab34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c06d9b6549088ae3ba720d7a19ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:18Z,use_quota=True,user_id='46622f5694704c77ac04cf5a895ed039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b298caa-31e8-4150-9c82-61c09ba21148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b298caa-31e8-4150-9c82-61c09ba21148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e16da1-6e2f-42d5-be2a-300367e0cd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e16da1-6e2f-42d5-be2a-300367e0cd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6c94ff0-3387-4f71-b188-31937ba7ab34', 'volume_name': 'volume-e6c94ff0-3387-4f71-b188-31937ba7ab34', 'volume_size': 1, 'image_id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6870c2b43f8e460842d1530da338c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69b7c06d9b6549088ae3ba720d7a19ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18942a9f3872eabd8593fba358279f1a45b0aa9e25e2ea9c9a4184064f31992be167332a61fd261115385e49eee71cd0b7a00db5d62ab243efd5163b9712543b', 'id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'created_at': datetime.datetime(2026, 11, 2, 10, 3, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 3, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6986fbc9-8332-459b-a059-c24c91ed1c8a/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd024b0e-f658-4be0-8c5c-a37fb96e7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd024b0e-f658-4be0-8c5c-a37fb96e7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4092c141-b3ef-43e6-855a-a85174deb992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Volume e6c94ff0-3387-4f71-b188-31937ba7ab34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6c94ff0-3387-4f71-b188-31937ba7ab34', 'volume_size': 1, 'image_id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6870c2b43f8e460842d1530da338c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69b7c06d9b6549088ae3ba720d7a19ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18942a9f3872eabd8593fba358279f1a45b0aa9e25e2ea9c9a4184064f31992be167332a61fd261115385e49eee71cd0b7a00db5d62ab243efd5163b9712543b', 'id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'created_at': datetime.datetime(2026, 11, 2, 10, 3, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 3, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6986fbc9-8332-459b-a059-c24c91ed1c8a/file', 'properties': {}}, 'image_service': } Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Trying to clone e6c94ff0-3387-4f71-b188-31937ba7ab34 from image 6986fbc9-8332-459b-a059-c24c91ed1c8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 02 11:03:18 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Image download 0.00 MB at 0.00 MB/s Nov 02 11:03:18 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 1073741824" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9437cdbd-2a87-47a3-8193-f5a7298bd41c]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 Nov 02 11:03:19 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:19 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:19 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200622774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=091ef5f0-6b73-4473-9d64-b35d08155d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume 091ef5f0-6b73-4473-9d64-b35d08155d9c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c 1073741824 Nov 02 11:03:19 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f8684d-5b3c-47f4-9c65-b04cbb7e7a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d0c16-4476-413c-aa81-f1cda37e6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 (d1d5b38f-9df9-43d3-85c2-68c3b13fb824): created successfully Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d0c16-4476-413c-aa81-f1cda37e6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (7cc0a56e-c8d0-4de5-966a-d5cc27726ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Deleting offline snapshot 416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d of volume 5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:19 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:19 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] snapshot_file for this snap is: volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02b93dc4-34f9-4b37-befd-a8ebf73c765d tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24a50f-15f1-4fa6-9683-8b7f4ac175c0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d Nov 02 11:03:19 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Temporary image 6986fbc9-8332-459b-a059-c24c91ed1c8a is fetched for user 46622f5694704c77ac04cf5a895ed039. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eeab3d-d7aa-428b-99e5-c0617313f3eb]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c 1073741824" returned: 0 in 0.506s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:19 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c Nov 02 11:03:19 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:19 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:19 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccb813c-d6cb-46a8-93b0-b8f00f7bddf7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 Nov 02 11:03:20 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.865s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-528591060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30178e79-8cef-4cfb-a99d-8c4d57980b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dbc7aeed0842d194cfb3d8049e0664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='2e4135f5a9604d4c9f9ab16f454b11ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Creating volume 30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:20 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 1073741824 Nov 02 11:03:20 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d62e4b2-7b6d-4ea5-8170-d99a05f8c199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091ef5f0-6b73-4473-9d64-b35d08155d9c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60651bc-d89f-4a1e-a143-20e8e8ab61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-091ef5f0-6b73-4473-9d64-b35d08155d9c (091ef5f0-6b73-4473-9d64-b35d08155d9c): created successfully Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60651bc-d89f-4a1e-a143-20e8e8ab61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (15b2d7df-fc02-4479-ac31-f9e08bad80b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c23903f9-1f8a-4d8c-a8bb-1399a2d2730b tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:20 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:20 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d Nov 02 11:03:20 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:20 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 1073741824" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:20 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d Nov 02 11:03:20 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.428s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4757125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6923794f-f924-407f-a802-19b99ab79a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef961b24d624ecda69862b2dc6a3960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:16Z,use_quota=True,user_id='5fd1210321e446708cbf73982de2b581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Creating volume 6923794f-f924-407f-a802-19b99ab79a39 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:20 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbeca16-2eb2-4bcb-ad0f-e0d09f73b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30178e79-8cef-4cfb-a99d-8c4d57980b72', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:20 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 1073741824 Nov 02 11:03:20 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12a0ee-40c8-4f3d-8394-04752dc7c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Volume volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 (30178e79-8cef-4cfb-a99d-8c4d57980b72): created successfully Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12a0ee-40c8-4f3d-8394-04752dc7c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Flow 'volume_create_manager' (5c905b77-31c6-41c4-a8b0-edd8132b437e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e79370e6-01d8-4727-ac45-7ad5de6dcf24 tempest-VolumeDependencyTests-1513474299 None] Created volume successfully. Nov 02 11:03:21 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3.416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d" released by "_delete_snapshot" :: held 1.644s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" released by "delete_snapshot" :: held 1.691s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Created reservations ['8b56a903-08f7-4701-b5d0-ce691dad75a7', '4ac65502-b610-432a-a029-ddf66216b53c', '1c08af72-dbb5-4bf0-a61e-d34489874ba1', 'ba71b012-69ad-4845-8e3b-56de15a7a9be'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Delete snapshot completed successfully. Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3c306664-cc39-42b2-8e7c-615f6150cc86 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-416b7fdb-578e-4f8d-b3e2-2ce5a6ebcf4d-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:21 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 1073741824" returned: 0 in 0.431s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:21 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-5c46d6e9-6e36-421b-b761-f25e0f4890e3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:21 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-5c46d6e9-6e36-421b-b761-f25e0f4890e3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0a6b3-1f43-4383-a19c-e2c5d75f9a4f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:21 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c94ff0-3387-4f71-b188-31937ba7ab34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c06d9b6549088ae3ba720d7a19ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:18Z,use_quota=True,user_id='46622f5694704c77ac04cf5a895ed039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Creating volume e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:21 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 Nov 02 11:03:21 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:21 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69df7c2d-f39b-4b3d-aa2e-f02bd59a17c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6923794f-f924-407f-a802-19b99ab79a39', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:21 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1073741824 Nov 02 11:03:21 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5da561-fc16-482d-8e63-4106247fb1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Volume volume-6923794f-f924-407f-a802-19b99ab79a39 (6923794f-f924-407f-a802-19b99ab79a39): created successfully Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5da561-fc16-482d-8e63-4106247fb1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Flow 'volume_create_manager' (ac71981a-1064-429e-b2cd-5d9fb03fcc8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-20ef39b1-6744-4712-af67-98bd426068bd tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created volume successfully. Nov 02 11:03:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-6923794f-f924-407f-a802-19b99ab79a39-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-6923794f-f924-407f-a802-19b99ab79a39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:22 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-6923794f-f924-407f-a802-19b99ab79a39" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-6923794f-f924-407f-a802-19b99ab79a39" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:22 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3 Nov 02 11:03:22 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b68d9b-bd53-4677-90e2-e945a5f4372d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 Nov 02 11:03:22 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1073741824" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 Nov 02 11:03:22 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5c46d6e9-6e36-421b-b761-f25e0f4890e3" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-5c46d6e9-6e36-421b-b761-f25e0f4890e3" released by "delete_volume" :: held 0.842s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Created reservations ['48ea9d26-fd41-4760-929b-22d12e8727fe', '2fc85acb-67c7-45f1-8e65-1d533367deed', 'fa73c496-036c-40af-aa59-58bf619b80bf', '00b4255f-d664-4c16-b53b-88d3b7810b76'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:22 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39 Nov 02 11:03:22 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.891s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Creating offline snapshot 68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc of volume 30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Attempting download of 6986fbc9-8332-459b-a059-c24c91ed1c8a ((None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}])) to volume e6c94ff0-3387-4f71-b188-31937ba7ab34. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a920f3da-0d28-47d8-9c4e-17fc20bebdf4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de322a77-af38-41e0-b38d-df81929531bc]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:22 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:22 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Deleted volume successfully. Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c2e25fa5-9cb8-4351-a1ee-d39b02836a67 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-5c46d6e9-6e36-421b-b761-f25e0f4890e3-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:22 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n Nov 02 11:03:22 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:22 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6923794f-f924-407f-a802-19b99ab79a39" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-6923794f-f924-407f-a802-19b99ab79a39" released by "delete_volume" :: held 0.852s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['a44e68cb-d7e5-4a89-82fe-c8b8eeec3219', '31cdd9ae-cbf0-4b9c-bd7f-20d109d200dc', '851d1e77-507b-4ef1-aac1-b637469190cd', '166681f9-b856-4683-bc98-49d537695feb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:23 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.569s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-091ef5f0-6b73-4473-9d64-b35d08155d9c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n" returned: 0 in 0.516s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc 1G Nov 02 11:03:23 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-091ef5f0-6b73-4473-9d64-b35d08155d9c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-091ef5f0-6b73-4473-9d64-b35d08155d9c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-091ef5f0-6b73-4473-9d64-b35d08155d9c" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:23 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n Nov 02 11:03:23 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (ce3d3f6f-48fb-4c9b-b026-a25c74fdc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd94505-f7d0-435a-9222-c96c5b955a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4507d28-060e-4c40-bfd5-25f32a03e62f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd94505-f7d0-435a-9222-c96c5b955a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034036354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2999c4-a6e7-4b43-9875-dd56b4dd372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:23Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcae3309-0b82-4f38-83b9-6f57ba23d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcae3309-0b82-4f38-83b9-6f57ba23d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241c1e62-9aca-457f-869d-cbc57874a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241c1e62-9aca-457f-869d-cbc57874a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2999c4-a6e7-4b43-9875-dd56b4dd372b', 'volume_name': 'volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe100c6f-c3c7-4c58-8ce4-ff5d9bae83af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe100c6f-c3c7-4c58-8ce4-ff5d9bae83af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfb15ca-5736-4a6f-929f-af113090660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Volume 6f2999c4-a6e7-4b43-9875-dd56b4dd372b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b', 'volume_size': 1} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:23 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:23 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c Nov 02 11:03:23 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5134e915-1acb-4727-a4c6-f31770b565b4 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-6923794f-f924-407f-a802-19b99ab79a39-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:23 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n" returned: 1 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6986fbc9-8332-459b-a059-c24c91ed1c8a_t1lthj_n' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[368e5cf4-e5b6-453c-964b-fe6b8d87491d]: (4, 'raw') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc 1G" returned: 0 in 0.533s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:23 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:23 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:23 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:23 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c Nov 02 11:03:23 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc is being set with open permissions: ugo+rw Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:24 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-091ef5f0-6b73-4473-9d64-b35d08155d9c" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD Nov 02 11:03:24 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-091ef5f0-6b73-4473-9d64-b35d08155d9c" released by "delete_volume" :: held 0.807s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['fac78d3c-5475-400d-9590-91986ca8fe25', 'b89ad952-45f7-4f8f-bd3f-7077ee3b793d', '37f27b6e-e85a-412d-bfa0-3f77b21c3560', '44704699-1cfa-42ff-b3c3-b74dcd80f40f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:24 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] 6986fbc9-8332-459b-a059-c24c91ed1c8a was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info Nov 02 11:03:24 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-d1d5b38f-9df9-43d3-85c2-68c3b13fb824-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:24 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 Nov 02 11:03:24 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-d1d5b38f-9df9-43d3-85c2-68c3b13fb824-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[955dad8f-8d11-4776-8600-c98407abe1c7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-47deec29-c430-492b-99a8-37a1b569d661 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-091ef5f0-6b73-4473-9d64-b35d08155d9c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:24 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info is being set with open permissions: ugo+rw Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 Nov 02 11:03:24 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info Nov 02 11:03:24 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6986fbc9-8332-459b-a059-c24c91ed1c8a_54au97xodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:03:24 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:24 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:24 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1G Nov 02 11:03:24 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.info" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:24 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034036354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2999c4-a6e7-4b43-9875-dd56b4dd372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:23Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Creating volume 6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:25 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b 1073741824 Nov 02 11:03:25 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:25 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824 Nov 02 11:03:25 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b81b4eaa-92a8-48f3-8961-fe496b7fdf8c tempest-VolumeDependencyTests-1513474299 None] Create snapshot completed successfully Nov 02 11:03:25 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 1G" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Downloaded image 6986fbc9-8332-459b-a059-c24c91ed1c8a ((None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}])) to volume e6c94ff0-3387-4f71-b188-31937ba7ab34 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Temporary image 6986fbc9-8332-459b-a059-c24c91ed1c8a for user 46622f5694704c77ac04cf5a895ed039 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Marking volume e6c94ff0-3387-4f71-b188-31937ba7ab34 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-d1d5b38f-9df9-43d3-85c2-68c3b13fb824" released by "delete_volume" :: held 0.775s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Copying metadata from image 6986fbc9-8332-459b-a059-c24c91ed1c8a to e6c94ff0-3387-4f71-b188-31937ba7ab34. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Creating volume glance metadata for volume e6c94ff0-3387-4f71-b188-31937ba7ab34 backed by image 6986fbc9-8332-459b-a059-c24c91ed1c8a with: {'image_id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e6870c2b43f8e460842d1530da338c3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['dbd76a40-fc82-47da-ad0c-92618f25ca0d', 'fec678ec-1783-42d6-889f-4cc88ce2e240', 'a7c85583-9e8c-48d5-880e-99093d6a8325', '3c285238-1df8-49f2-9f72-838959982a18'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4092c141-b3ef-43e6-855a-a85174deb992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c94ff0-3387-4f71-b188-31937ba7ab34', 'volume_size': 1, 'image_id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6986fbc9-8332-459b-a059-c24c91ed1c8a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6870c2b43f8e460842d1530da338c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69b7c06d9b6549088ae3ba720d7a19ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '18942a9f3872eabd8593fba358279f1a45b0aa9e25e2ea9c9a4184064f31992be167332a61fd261115385e49eee71cd0b7a00db5d62ab243efd5163b9712543b', 'id': '6986fbc9-8332-459b-a059-c24c91ed1c8a', 'created_at': datetime.datetime(2026, 11, 2, 10, 3, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 10, 3, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6986fbc9-8332-459b-a059-c24c91ed1c8a/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba77798-502f-4683-8790-e004eb2a5bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Volume volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 (e6c94ff0-3387-4f71-b188-31937ba7ab34): created successfully Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba77798-502f-4683-8790-e004eb2a5bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Flow 'volume_create_manager' (b935aa85-986d-4f05-bffc-470c1b024ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5cb9ff0c-1fec-439e-adc2-a9e6577f4b6b tempest-VolumeImageDependencyTests-2006252062 None] Created volume successfully. Nov 02 11:03:25 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b 1073741824" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:25 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:25 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:25 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b Nov 02 11:03:25 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-f3588127-2ec0-45dd-8f46-2d73386083bc-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-f3588127-2ec0-45dd-8f46-2d73386083bc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-f3588127-2ec0-45dd-8f46-2d73386083bc" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-f3588127-2ec0-45dd-8f46-2d73386083bc" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e97887-4b78-4fa1-ae2c-781dbf773d97]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:25 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:25 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c802e739-afbd-4e7d-8a44-b250edfb2cf0 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-d1d5b38f-9df9-43d3-85c2-68c3b13fb824-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfb15ca-5736-4a6f-929f-af113090660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44996efa-9ebc-45e9-b8b0-b1a910331653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Volume volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b (6f2999c4-a6e7-4b43-9875-dd56b4dd372b): created successfully Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44996efa-9ebc-45e9-b8b0-b1a910331653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (ce3d3f6f-48fb-4c9b-b026-a25c74fdc945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7bcbdc50-ebfb-41f4-9ae6-799763e69864 tempest-ProjectReaderTests-1133394238 None] Created volume successfully. Nov 02 11:03:25 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc Nov 02 11:03:25 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Acquiring lock "cinder-e6c94ff0-3387-4f71-b188-31937ba7ab34-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "cinder-e6c94ff0-3387-4f71-b188-31937ba7ab34-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Acquiring lock "cinder-quobyte-e6c94ff0-3387-4f71-b188-31937ba7ab34" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "cinder-quobyte-e6c94ff0-3387-4f71-b188-31937ba7ab34" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6830c389-62a3-4655-a2e5-343c5ef2a47c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:26 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:26 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc Nov 02 11:03:26 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:26 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 Nov 02 11:03:26 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:26 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f3588127-2ec0-45dd-8f46-2d73386083bc" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-f3588127-2ec0-45dd-8f46-2d73386083bc" released by "delete_volume" :: held 0.835s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Flow 'volume_create_manager' (0a4479b1-21c9-439f-b604-bd28c1fac8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad4d4d-62de-4ffb-a599-71b583002067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad4d4d-62de-4ffb-a599-71b583002067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1595417675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a4e29a-d039-4748-8393-e63043f14a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7dbc7aeed0842d194cfb3d8049e0664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:27Z,use_quota=True,user_id='2e4135f5a9604d4c9f9ab16f454b11ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:26 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84c4ce2-8ce1-49a0-91ed-a4d3814dc40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84c4ce2-8ce1-49a0-91ed-a4d3814dc40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a0cf1a-bdde-4196-a0b6-fd86dbc5d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a0cf1a-bdde-4196-a0b6-fd86dbc5d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0a4e29a-d039-4748-8393-e63043f14a77', 'volume_name': 'volume-f0a4e29a-d039-4748-8393-e63043f14a77', 'volume_size': 1, 'snapshot_id': '68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50158ac0-8ac5-41d2-b9a4-a98a25fd1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50158ac0-8ac5-41d2-b9a4-a98a25fd1075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6118a23-4313-4de9-9f9f-5c44459c03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Volume f0a4e29a-d039-4748-8393-e63043f14a77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0a4e29a-d039-4748-8393-e63043f14a77', 'volume_size': 1, 'snapshot_id': '68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc'} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-f0a4e29a-d039-4748-8393-e63043f14a77" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:26 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34 Nov 02 11:03:26 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-f0a4e29a-d039-4748-8393-e63043f14a77" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Creating volume f0a4e29a-d039-4748-8393-e63043f14a77 from snapshot 68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['aee4ddd9-b8ce-4e6f-886b-643751c722bc', 'a38ca340-7c12-48ac-817e-b63d5642af36', 'ae285210-879a-4f19-99f5-0055d970f037', 'a46fcf75-9d13-4941-83d8-7c1c3c3b7103'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] snapshot: 68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc, volume: f0a4e29a-d039-4748-8393-e63043f14a77, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e769f2e6-9cb3-4e8b-8cc3-f7a6442496de]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:26 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:26 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:27 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:27 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:27 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-e6c94ff0-3387-4f71-b188-31937ba7ab34" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "cinder-quobyte-e6c94ff0-3387-4f71-b188-31937ba7ab34" released by "delete_volume" :: held 0.851s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Created reservations ['7ad6cf31-1da6-4fd9-b4c4-41ea97f5bbd6', 'c1e45d0d-0963-4588-877c-3dec6d3c3e77', '099b9c05-6b10-407f-8787-d0ea109ba719', 'a5cb96dd-f2e9-4f69-ae19-2aa8fa2b726d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:27 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:27 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:27 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a406d18b-eecb-4e2f-9b00-3391f2af95f3 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-f3588127-2ec0-45dd-8f46-2d73386083bc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:27 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.444s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30178e79-8cef-4cfb-a99d-8c4d57980b72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44dcf4-1421-4bca-8622-eb9628b2d746]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:27 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:27 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:27 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Deleted volume successfully. Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-128c3758-76c7-40e7-a6aa-491b805ae809 tempest-VolumeImageDependencyTests-2006252062 None] Lock "cinder-e6c94ff0-3387-4f71-b188-31937ba7ab34-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:27 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:27 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 Nov 02 11:03:27 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-58f81cac-eeb6-4417-915e-22690575687c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-58f81cac-eeb6-4417-915e-22690575687c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-58f81cac-eeb6-4417-915e-22690575687c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-58f81cac-eeb6-4417-915e-22690575687c" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[75944532-2050-4fa9-9051-fbee744441d2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:28 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c Nov 02 11:03:28 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:28 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c" returned: 0 in 0.661s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:28 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c Nov 02 11:03:28 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:29 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-58f81cac-eeb6-4417-915e-22690575687c" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-58f81cac-eeb6-4417-915e-22690575687c" released by "delete_volume" :: held 1.229s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['950472fb-d67f-46e5-a798-b1ad576994d2', '24611938-e06f-4002-93a9-d30539627f66', 'a882f165-9e93-462b-9044-ed34d730915a', '748745f4-8337-4bed-85fa-2fceb13974bd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:29 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:29 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:30 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.490s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f56bdb26-1c14-42cc-9236-31429b93ba13 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-58f81cac-eeb6-4417-915e-22690575687c-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-cea237b7-198f-442d-a018-c54bd927bccd-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-cea237b7-198f-442d-a018-c54bd927bccd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-cea237b7-198f-442d-a018-c54bd927bccd" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-cea237b7-198f-442d-a018-c54bd927bccd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleting offline snapshot cea237b7-198f-442d-a018-c54bd927bccd of volume 63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] snapshot_file for this snap is: volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c50436-a8dc-4196-a250-0f8581368c50]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:30 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd Nov 02 11:03:30 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:31 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63634cdb-d268-43a2-aa96-91452c666e21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dab9cd-4aee-4109-9ef7-c701e9535d65]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:31 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 Nov 02 11:03:31 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:31 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21" returned: 0 in 0.665s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:31 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd Nov 02 11:03:31 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:32 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd" returned: 0 in 0.727s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:32 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd Nov 02 11:03:32 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:33 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21.cea237b7-198f-442d-a018-c54bd927bccd" returned: 0 in 0.628s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-cea237b7-198f-442d-a018-c54bd927bccd" released by "_delete_snapshot" :: held 2.901s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" released by "delete_snapshot" :: held 2.953s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['21aa658a-6025-45b7-b270-1ab90b74c004', '80f39072-c0b9-4e22-a15b-784ca579bc92', '647c4958-64e7-4d53-8533-c89f55754cec', '511b478e-6321-48d4-afae-885651768ace'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Delete snapshot completed successfully. Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c21ffea9-cb22-4830-8c04-9be6246783d9 tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-cea237b7-198f-442d-a018-c54bd927bccd-delete_snapshot" released by "delete_snapshot" :: held 3.278s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-63634cdb-d268-43a2-aa96-91452c666e21-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-63634cdb-d268-43a2-aa96-91452c666e21-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4f048-a393-4337-9490-7b5aa0bfcd33]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:34 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 Nov 02 11:03:34 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:34 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21" returned: 0 in 0.742s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:34 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21 Nov 02 11:03:34 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:35 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-63634cdb-d268-43a2-aa96-91452c666e21" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-quobyte-63634cdb-d268-43a2-aa96-91452c666e21" released by "delete_volume" :: held 1.420s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Created reservations ['7adcbbe0-ab6c-4315-8872-910b7d49b0da', 'e1c713f5-d5d0-4484-a89d-c35140dc44ce', '0ac1e049-ae59-4a0e-997a-8b535d7e1452', 'dd8b89db-baf6-45c5-b59f-00a79bb2fc54'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:35 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:35 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:35 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77" returned: 0 in 7.905s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72, size 1024.00 MB, duration 7.91 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:03:35 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Converted 1024.00 MB image at 129.52 MB/s Nov 02 11:03:35 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 is being set with open permissions: ugo+rw Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:35 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 Nov 02 11:03:35 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:35 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Deleted volume successfully. Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1507f0b5-f117-4adf-8bd6-cd14ebf2cffc tempest-CreateVolumesFromSnapshotTest-1669510123 None] Lock "cinder-63634cdb-d268-43a2-aa96-91452c666e21-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:35 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" released by "_copy_volume_from_snapshot" :: held 9.107s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-f0a4e29a-d039-4748-8393-e63043f14a77" released by "_create_volume_from_snapshot" :: held 9.189s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.218s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.213s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Creating offline snapshot f48f4e7e-dded-439f-be8b-d81bda6dbc93 of volume 6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6118a23-4313-4de9-9f9f-5c44459c03a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a4e29a-d039-4748-8393-e63043f14a77', 'volume_size': 1, 'snapshot_id': '68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c9e27d-d614-4d57-89cb-5b650c8c1ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b813736-2b19-48f2-883d-2264f2df0478]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Volume volume-f0a4e29a-d039-4748-8393-e63043f14a77 (f0a4e29a-d039-4748-8393-e63043f14a77): created successfully Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c9e27d-d614-4d57-89cb-5b650c8c1ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Flow 'volume_create_manager' (0a4479b1-21c9-439f-b604-bd28c1fac8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9f45ffc2-f324-43cf-ba3d-06a75b7e001c tempest-VolumeDependencyTests-1513474299 None] Created volume successfully. Nov 02 11:03:36 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b Nov 02 11:03:36 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:36 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:36 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 1G Nov 02 11:03:36 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Deleting offline snapshot 68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc of volume 30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] snapshot_file for this snap is: volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e81e05-6aa7-460a-8d2d-fb04a6d0b6de]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:36 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:36 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:37 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 1G" returned: 0 in 0.560s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:37 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 Nov 02 11:03:37 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:37 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30178e79-8cef-4cfb-a99d-8c4d57980b72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32a033-90e1-46e4-ad31-0fa5c533bd34]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:37 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:37 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 is being set with open permissions: ugo+rw Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:37 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 Nov 02 11:03:37 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:37 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:37 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:37 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:37 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info Nov 02 11:03:37 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:37 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.636s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:37 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:37 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:38 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:38 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info is being set with open permissions: ugo+rw Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:38 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info Nov 02 11:03:38 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:38 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:38 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc Nov 02 11:03:38 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:38 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.info" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba14b492-5bb0-47df-b469-6bfe9c83a6ee tempest-ProjectReaderTests-1133394238 None] Create snapshot completed successfully Nov 02 11:03:38 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72.68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc" released by "_delete_snapshot" :: held 1.832s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" released by "delete_snapshot" :: held 1.872s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Created reservations ['51e2933d-1b87-4e9e-a123-208bd06d4271', 'fac042da-897e-4fbd-b43f-1d5bff24f534', 'b47f213f-f903-4482-aa89-94d46d128b88', '67c21450-6192-4fe8-a1a8-04e5a285aae3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Delete snapshot completed successfully. Nov 02 11:03:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c79251e7-5107-4bc7-a237-6cd9ac35b9bf tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-68f6d5d7-83df-4f8c-9b4b-4ae5d8449cdc-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-30178e79-8cef-4cfb-a99d-8c4d57980b72-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-30178e79-8cef-4cfb-a99d-8c4d57980b72-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc38247b-16d1-470c-a9bc-e86ff73d3853]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:39 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:39 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-f48f4e7e-dded-439f-be8b-d81bda6dbc93-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-f48f4e7e-dded-439f-be8b-d81bda6dbc93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-f48f4e7e-dded-439f-be8b-d81bda6dbc93" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-f48f4e7e-dded-439f-be8b-d81bda6dbc93" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Deleting offline snapshot f48f4e7e-dded-439f-be8b-d81bda6dbc93 of volume 6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] snapshot_file for this snap is: volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[41889f61-afed-4499-b7b5-d5f32a08d2b7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:39 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 Nov 02 11:03:39 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:39 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:39 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72 Nov 02 11:03:39 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:40 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76eb99-ae69-43e8-8bae-76b6fea6ebe5]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:40 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-30178e79-8cef-4cfb-a99d-8c4d57980b72" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7cada48c-a01b-4192-b829-61c4f806f354 tempest-ProjectAdminTests-1863773506 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8103370666504, 'free_capacity_gb': 1773.8103370666504, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-30178e79-8cef-4cfb-a99d-8c4d57980b72" released by "delete_volume" :: held 0.963s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Created reservations ['44d63c92-4e6b-461d-a645-b27b8dd91c81', 'a70a41cc-6b45-4a0d-bc15-3e66f7cc3bea', 'e2098dfd-e29a-4f7a-aa1a-c1e73dd6af66', '6e4f9f69-99f0-4c5a-bbe8-ed11a66e91c0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:40 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b Nov 02 11:03:40 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:40 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:40 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:40 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:40 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 Nov 02 11:03:40 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:40 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Deleted volume successfully. Nov 02 11:03:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b0015c2c-c281-4691-8ffd-aa0e09e27800 tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-30178e79-8cef-4cfb-a99d-8c4d57980b72-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:41 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:41 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93 Nov 02 11:03:41 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:41 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b.f48f4e7e-dded-439f-be8b-d81bda6dbc93" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-f48f4e7e-dded-439f-be8b-d81bda6dbc93" released by "_delete_snapshot" :: held 1.753s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" released by "delete_snapshot" :: held 1.789s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Created reservations ['b52da9c8-dec0-4b08-b866-aad0df3f0b8d', '344ddd37-dda3-43bd-beac-ee5f1fa6c502', 'b19e3cb1-2d8d-403b-a971-d2c3eabcc444', '54bb1547-62cd-4dbc-a054-bc439e663116'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-f0a4e29a-d039-4748-8393-e63043f14a77-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-f0a4e29a-d039-4748-8393-e63043f14a77-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Delete snapshot completed successfully. Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6fdcb37e-e43c-4803-8170-ad3d0e09f858 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-f48f4e7e-dded-439f-be8b-d81bda6dbc93-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f910a6-2b9f-44f6-82cf-6f2b53d21c88]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-6f2999c4-a6e7-4b43-9875-dd56b4dd372b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-6f2999c4-a6e7-4b43-9875-dd56b4dd372b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:41 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 Nov 02 11:03:41 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db4cd81-761e-4c0c-bf3f-6bc9830af312]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:42 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b Nov 02 11:03:42 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:42 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77" returned: 0 in 0.525s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:42 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77 Nov 02 11:03:42 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:42 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:42 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b Nov 02 11:03:42 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:42 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-f0a4e29a-d039-4748-8393-e63043f14a77" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-quobyte-f0a4e29a-d039-4748-8393-e63043f14a77" released by "delete_volume" :: held 0.908s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Created reservations ['7c11d6ed-f0e4-484a-a3f7-50bc98c5e674', '7f4a743e-9c32-4241-b218-9a94d4c48e4e', '4d83468b-cc75-4563-be68-9d60e7364d50', '6aafb272-aba8-4b7e-80b9-128f0fc37146'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:42 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:42 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:42 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-6f2999c4-a6e7-4b43-9875-dd56b4dd372b" released by "delete_volume" :: held 0.924s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Created reservations ['423a7829-2302-435b-a142-a41ccd0f9e25', '283fcce5-a211-4e3c-974d-8ece82b285dc', 'ccc0b5ca-0c25-40d6-9087-ab9ec094dd0c', '04f061fc-aca9-481e-ab13-0026d315177a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:43 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:43 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:43 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Deleted volume successfully. Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a61ae4a3-3187-4579-acb2-d8dd8a90c8ee tempest-VolumeDependencyTests-1513474299 None] Lock "cinder-f0a4e29a-d039-4748-8393-e63043f14a77-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:43 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Deleted volume successfully. Nov 02 11:03:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2faa7975-04a7-4f88-9bda-6ac4b3c607f1 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-6f2999c4-a6e7-4b43-9875-dd56b4dd372b-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (ffae4e0f-d9b0-4142-9e7a-45aca9973f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3083d1-1533-4bea-b7af-ede8d0a87602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3083d1-1533-4bea-b7af-ede8d0a87602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109711547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7c56b0-a5f5-40a6-b01e-8b482e55620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:45Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe043b-4b62-4277-8a4c-0fa68971f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe043b-4b62-4277-8a4c-0fa68971f51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7166a1-6284-4051-ab48-fbd2389695a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7166a1-6284-4051-ab48-fbd2389695a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7c56b0-a5f5-40a6-b01e-8b482e55620a', 'volume_name': 'volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0708b7f0-c091-47c3-8a1a-7128b6c80426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0708b7f0-c091-47c3-8a1a-7128b6c80426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c493bfb-7785-403f-b1ce-a9192d435cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Volume cd7c56b0-a5f5-40a6-b01e-8b482e55620a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a', 'volume_size': 1} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109711547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7c56b0-a5f5-40a6-b01e-8b482e55620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:45Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Creating volume cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:44 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:44 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a 1073741824 Nov 02 11:03:44 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:45 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a 1073741824" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:45 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a Nov 02 11:03:45 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:45 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c493bfb-7785-403f-b1ce-a9192d435cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9c6e3-d8d6-4fd8-9cdf-6d62d85bceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:45 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Volume volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a (cd7c56b0-a5f5-40a6-b01e-8b482e55620a): created successfully Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e9c6e3-d8d6-4fd8-9cdf-6d62d85bceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (ffae4e0f-d9b0-4142-9e7a-45aca9973f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7d1e8221-0461-4fe8-97d4-cdb03841c3eb tempest-ProjectReaderTests-1133394238 None] Created volume successfully. Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Creating offline snapshot f232dadd-f317-46e7-b4ea-35ead9228bef of volume cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a62db-ef73-4103-871f-461a0c20ef36]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:47 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a Nov 02 11:03:47 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Flow 'volume_create_manager' (9596c804-6186-4622-8cdc-e5699d2e0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875599e-a7ff-4773-8350-7f502c224a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875599e-a7ff-4773-8350-7f502c224a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bdd639-9a73-437d-b252-fb6edd43a165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9a3aac209e48e59d5fe6565a9eb019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:47Z,use_quota=True,user_id='de0c735f84c244329307f6b9e795974d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c0175a-75a3-4c24-aef6-b340d4ab391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c0175a-75a3-4c24-aef6-b340d4ab391c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:47 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2745ea08-5086-497d-9bbb-a861e630af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2745ea08-5086-497d-9bbb-a861e630af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bdd639-9a73-437d-b252-fb6edd43a165', 'volume_name': 'volume-10bdd639-9a73-437d-b252-fb6edd43a165', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e553cf-0519-4f53-bd05-8841a3e667fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e553cf-0519-4f53-bd05-8841a3e667fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01438c17-56e1-47d2-b981-27b41e04f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Volume 10bdd639-9a73-437d-b252-fb6edd43a165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bdd639-9a73-437d-b252-fb6edd43a165', 'volume_size': 1} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:47 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef 1G Nov 02 11:03:47 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:48 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef 1G" returned: 0 in 0.453s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:48 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef Nov 02 11:03:48 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:48 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef" returned: 0 in 0.332s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:48 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef is being set with open permissions: ugo+rw Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:48 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef Nov 02 11:03:48 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:48 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:48 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info Nov 02 11:03:48 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:48 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:48 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info is being set with open permissions: ugo+rw Nov 02 11:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:48 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info Nov 02 11:03:48 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:49 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.info" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bdd639-9a73-437d-b252-fb6edd43a165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9a3aac209e48e59d5fe6565a9eb019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:47Z,use_quota=True,user_id='de0c735f84c244329307f6b9e795974d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Creating volume 10bdd639-9a73-437d-b252-fb6edd43a165 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=240,cinder:UPDATE=313,cinder:INSERT=83,cinder:DELETE=22 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=301,cinder:SELECT=211,cinder:INSERT=83,cinder:DELETE=32 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:03:49 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 1073741824 Nov 02 11:03:49 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1cd68d17-f03b-45c6-a112-1b0d180d0a93 tempest-ProjectReaderTests-1133394238 None] Create snapshot completed successfully Nov 02 11:03:49 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 1073741824" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:49 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 Nov 02 11:03:49 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:49 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01438c17-56e1-47d2-b981-27b41e04f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bdd639-9a73-437d-b252-fb6edd43a165', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff9723-edbf-4034-a634-7cf5f8273425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Volume volume-10bdd639-9a73-437d-b252-fb6edd43a165 (10bdd639-9a73-437d-b252-fb6edd43a165): created successfully Nov 02 11:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ff9723-edbf-4034-a634-7cf5f8273425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Flow 'volume_create_manager' (9596c804-6186-4622-8cdc-e5699d2e0412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b8943ea9-2b10-4a62-8da1-e62e3b6ddbff tempest-CinderUnicodeTest-1194085769 None] Created volume successfully. Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-f232dadd-f317-46e7-b4ea-35ead9228bef-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-f232dadd-f317-46e7-b4ea-35ead9228bef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-f232dadd-f317-46e7-b4ea-35ead9228bef" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-f232dadd-f317-46e7-b4ea-35ead9228bef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Deleting offline snapshot f232dadd-f317-46e7-b4ea-35ead9228bef of volume cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] snapshot_file for this snap is: volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[617cb8e3-93cf-4e8e-a37c-865b2bf863d8]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:50 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef Nov 02 11:03:50 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Flow 'volume_create_manager' (9b6f5607-78dd-4721-9b03-e97cf5518921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da03247c-777f-403a-a8d8-542f3742fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da03247c-777f-403a-a8d8-542f3742fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130788502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd320d9-ffa6-421c-a56c-5df9bf55ca94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37925c3bf4b4e6c9898beb9fd63d29c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:51Z,use_quota=True,user_id='1ba96b8cd4b84a38bdc8167ab4d83a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0046d9af-6e3f-4a64-b0be-f46da541291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0046d9af-6e3f-4a64-b0be-f46da541291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38557e57-797b-4c29-a1b9-070abeff12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38557e57-797b-4c29-a1b9-070abeff12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd320d9-ffa6-421c-a56c-5df9bf55ca94', 'volume_name': 'volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84019315-cbc6-40c5-9b6e-aac4632cb343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84019315-cbc6-40c5-9b6e-aac4632cb343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b2e44-48b6-4bff-84d6-dc3c3543c4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Volume 5cd320d9-ffa6-421c-a56c-5df9bf55ca94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94', 'volume_size': 1} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130788502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd320d9-ffa6-421c-a56c-5df9bf55ca94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37925c3bf4b4e6c9898beb9fd63d29c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:51Z,use_quota=True,user_id='1ba96b8cd4b84a38bdc8167ab4d83a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Creating volume 5cd320d9-ffa6-421c-a56c-5df9bf55ca94 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:50 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 1073741824 Nov 02 11:03:50 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:50 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9bef8-9c94-44f6-90d0-6a844de52e81]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:50 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a Nov 02 11:03:50 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:51 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 1073741824" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:51 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:51 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef Nov 02 11:03:51 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Flow 'volume_create_manager' (a473a3fc-8b8b-4d32-96cd-359509becde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147c6021-0a0d-434f-85fc-e6ace3ed7850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147c6021-0a0d-434f-85fc-e6ace3ed7850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1593067319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc8ef05-d5e1-44e8-97a0-197334e2da9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9a3aac209e48e59d5fe6565a9eb019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:51Z,use_quota=True,user_id='de0c735f84c244329307f6b9e795974d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 Nov 02 11:03:51 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5c2d08-14a7-4fd7-9246-47ffc170cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5c2d08-14a7-4fd7-9246-47ffc170cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9d6d7e-7229-40ea-8ed7-493117d2e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9d6d7e-7229-40ea-8ed7-493117d2e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc8ef05-d5e1-44e8-97a0-197334e2da9f', 'volume_name': 'volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84131eb5-a5a8-4a58-9945-594092fc2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84131eb5-a5a8-4a58-9945-594092fc2b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dd5aa2-332e-4d3a-8e96-ecb3f0529b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Volume cfc8ef05-d5e1-44e8-97a0-197334e2da9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f', 'volume_size': 1} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:51 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1593067319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc8ef05-d5e1-44e8-97a0-197334e2da9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c9a3aac209e48e59d5fe6565a9eb019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:51Z,use_quota=True,user_id='de0c735f84c244329307f6b9e795974d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Creating volume cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:51 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:51 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f 1073741824 Nov 02 11:03:51 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:51 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b2e44-48b6-4bff-84d6-dc3c3543c4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b463dd1-a0f4-42da-8ae3-d3fdd994c35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Volume volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 (5cd320d9-ffa6-421c-a56c-5df9bf55ca94): created successfully Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b463dd1-a0f4-42da-8ae3-d3fdd994c35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Flow 'volume_create_manager' (9b6f5607-78dd-4721-9b03-e97cf5518921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-53ae6ab9-2bc8-4803-a6c9-cc54cd5bb674 tempest-ProjectReaderTests-484658179 None] Created volume successfully. Nov 02 11:03:51 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a.f232dadd-f317-46e7-b4ea-35ead9228bef" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-f232dadd-f317-46e7-b4ea-35ead9228bef" released by "_delete_snapshot" :: held 1.608s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" released by "delete_snapshot" :: held 1.632s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Created reservations ['cc6bd47d-9737-4a5e-8a52-30c2834ad6d9', '50ef1093-6b39-491a-9faa-45e8e1f17fe5', 'ceb63e08-563d-4c27-a6c5-1b5757da969d', '4470e1fd-a227-492f-9cf1-39c2eb6259dc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Delete snapshot completed successfully. Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce0526e9-e5cb-471b-a829-c377b4d62094 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-f232dadd-f317-46e7-b4ea-35ead9228bef-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:52 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f 1073741824" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:52 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f Nov 02 11:03:52 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:52 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dd5aa2-332e-4d3a-8e96-ecb3f0529b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2467f7c-e6df-4a54-bfae-28cc42cdd6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Volume volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f (cfc8ef05-d5e1-44e8-97a0-197334e2da9f): created successfully Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2467f7c-e6df-4a54-bfae-28cc42cdd6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Flow 'volume_create_manager' (a473a3fc-8b8b-4d32-96cd-359509becde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-cd7c56b0-a5f5-40a6-b01e-8b482e55620a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0f76fcd4-5f84-4a38-860a-b53b52184c58 tempest-CinderUnicodeTest-1194085769 None] Created volume successfully. Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "cinder-cd7c56b0-a5f5-40a6-b01e-8b482e55620a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06770d-3216-4942-b823-1d49cc00fdba]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:52 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a Nov 02 11:03:52 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Acquiring lock "cinder-5cd320d9-ffa6-421c-a56c-5df9bf55ca94-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "cinder-5cd320d9-ffa6-421c-a56c-5df9bf55ca94-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Acquiring lock "cinder-quobyte-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "cinder-quobyte-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:52 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1314cf2b-eacf-437b-b2d5-08c1547b8ce2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:52 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a Nov 02 11:03:52 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:53 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 Nov 02 11:03:53 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:53 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-cd7c56b0-a5f5-40a6-b01e-8b482e55620a" released by "delete_volume" :: held 0.702s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Created reservations ['fecc3b3f-69e3-4565-b5fd-fdfb06a8e7e4', '9b914c95-574f-4f67-a576-2b0b83f9caca', 'f34d8656-6b66-4e59-8f39-2146d66d6d04', 'cc05c158-b593-422c-9c43-fd9759936d09'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:53 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:53 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:53 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:53 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94 Nov 02 11:03:53 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:53 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Deleted volume successfully. Nov 02 11:03:53 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Creating offline snapshot d5784bde-0a5f-438e-8c28-fb9ffa77370b of volume cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ebdb1-c4ec-485a-a285-a523da4ae13e]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "cinder-quobyte-5cd320d9-ffa6-421c-a56c-5df9bf55ca94" released by "delete_volume" :: held 0.799s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8243f328-5342-4b35-a04d-ecdbd0dfc96e tempest-ProjectReaderTests-1133394238 None] Lock "cinder-cd7c56b0-a5f5-40a6-b01e-8b482e55620a-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Created reservations ['d00027b6-6c19-46ac-a41f-5097ddbd6c62', 'c2cc5dbb-076c-4120-a056-cb1a36e55bc3', '00ff2dfc-8858-466f-be4e-62edceeaf3ef', '3889499e-a8dc-460f-ba24-ce5e15d91001'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:53 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f Nov 02 11:03:53 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:53 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:53 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:54 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:54 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Deleted volume successfully. Nov 02 11:03:54 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b 1G Nov 02 11:03:54 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (f07e8b64-12f4-426a-b5bf-369797c2a831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e567fdbc-571e-421c-8135-5a10edbc9337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d4455c1-412b-4b1e-ab8f-bff14e716918 tempest-ProjectReaderTests-484658179 None] Lock "cinder-5cd320d9-ffa6-421c-a56c-5df9bf55ca94-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e567fdbc-571e-421c-8135-5a10edbc9337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415243370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529fda04-1b68-41b3-9016-678e9e44c77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:54Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b058704-fc3f-47c2-82e8-ce9ca2ef8d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b058704-fc3f-47c2-82e8-ce9ca2ef8d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2049a956-24da-4df5-bf9a-f4901b4f8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2049a956-24da-4df5-bf9a-f4901b4f8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529fda04-1b68-41b3-9016-678e9e44c77f', 'volume_name': 'volume-529fda04-1b68-41b3-9016-678e9e44c77f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a5e08a-0643-4bb0-9511-8569fb82e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a5e08a-0643-4bb0-9511-8569fb82e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a0f323-7649-4319-9f04-f18a76cd0a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Volume 529fda04-1b68-41b3-9016-678e9e44c77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529fda04-1b68-41b3-9016-678e9e44c77f', 'volume_size': 1} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Flow 'volume_create_manager' (60b87f87-3c42-4d51-b724-9d68f5b82161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1796852-f062-4890-93b8-93651b81a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b 1G" returned: 0 in 0.422s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1796852-f062-4890-93b8-93651b81a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784754157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc79fd5-c341-4120-8f59-1752643af493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37925c3bf4b4e6c9898beb9fd63d29c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:54Z,use_quota=True,user_id='1ba96b8cd4b84a38bdc8167ab4d83a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79765d05-191f-4088-af0c-a1672507dadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b Nov 02 11:03:54 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79765d05-191f-4088-af0c-a1672507dadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3a073b-bfd0-472e-9a25-818bdfba0a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3a073b-bfd0-472e-9a25-818bdfba0a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc79fd5-c341-4120-8f59-1752643af493', 'volume_name': 'volume-0dc79fd5-c341-4120-8f59-1752643af493', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8637f664-c120-4b39-a78c-d86a20b8ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8637f664-c120-4b39-a78c-d86a20b8ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314a2097-77bc-4b20-baa7-b4c3b9b651a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Volume 0dc79fd5-c341-4120-8f59-1752643af493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc79fd5-c341-4120-8f59-1752643af493', 'volume_size': 1} Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:54 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:54 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b is being set with open permissions: ugo+rw Nov 02 11:03:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:54 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b Nov 02 11:03:54 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:55 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:55 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info Nov 02 11:03:55 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:55 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:55 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info is being set with open permissions: ugo+rw Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:55 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info Nov 02 11:03:55 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:55 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.info" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415243370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529fda04-1b68-41b3-9016-678e9e44c77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942447da79e44daa7d56a61be86860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:54Z,use_quota=True,user_id='0129796dc23b442e8b4bcb9ea9bf4ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Creating volume 529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:55 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f 1073741824 Nov 02 11:03:55 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce18e81a-77a5-45ae-bc59-cf077c218af6 tempest-CinderUnicodeTest-1194085769 None] Create snapshot completed successfully Nov 02 11:03:56 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f 1073741824" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:56 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f Nov 02 11:03:56 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:56 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784754157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc79fd5-c341-4120-8f59-1752643af493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e37925c3bf4b4e6c9898beb9fd63d29c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:03:54Z,use_quota=True,user_id='1ba96b8cd4b84a38bdc8167ab4d83a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Creating volume 0dc79fd5-c341-4120-8f59-1752643af493 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:03:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a0f323-7649-4319-9f04-f18a76cd0a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529fda04-1b68-41b3-9016-678e9e44c77f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:56 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 1073741824 Nov 02 11:03:56 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b70ee1-da88-4eb7-83ee-7f1b8dbab2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Volume volume-529fda04-1b68-41b3-9016-678e9e44c77f (529fda04-1b68-41b3-9016-678e9e44c77f): created successfully Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b70ee1-da88-4eb7-83ee-7f1b8dbab2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Flow 'volume_create_manager' (f07e8b64-12f4-426a-b5bf-369797c2a831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6023b9eb-fb69-4222-b9ae-f759bb289e53 tempest-ProjectReaderTests-1133394238 None] Created volume successfully. Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-d5784bde-0a5f-438e-8c28-fb9ffa77370b-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-d5784bde-0a5f-438e-8c28-fb9ffa77370b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-quobyte-d5784bde-0a5f-438e-8c28-fb9ffa77370b" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-d5784bde-0a5f-438e-8c28-fb9ffa77370b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Deleting offline snapshot d5784bde-0a5f-438e-8c28-fb9ffa77370b of volume cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:03:56 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] snapshot_file for this snap is: volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 1073741824" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1c98f3-f15a-4dc6-b8b2-a16eafd87d0b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:56 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 Nov 02 11:03:56 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:56 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b Nov 02 11:03:56 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:57 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314a2097-77bc-4b20-baa7-b4c3b9b651a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc79fd5-c341-4120-8f59-1752643af493', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4863f7-1c7c-4860-9e61-a22b453abc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:03:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Volume volume-0dc79fd5-c341-4120-8f59-1752643af493 (0dc79fd5-c341-4120-8f59-1752643af493): created successfully Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4863f7-1c7c-4860-9e61-a22b453abc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Flow 'volume_create_manager' (60b87f87-3c42-4d51-b724-9d68f5b82161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:03:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-00d621ef-1f52-450a-bb67-94cef80b3adf tempest-ProjectReaderTests-484658179 None] Created volume successfully. Nov 02 11:03:57 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e31b9d-3083-48e6-bf23-45b21f49d0dd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:57 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f Nov 02 11:03:57 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Creating offline snapshot 355c4671-dea1-4c3b-8f50-d20ab8750500 of volume 529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed002170-53a7-48d6-b830-df958da8bb66]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:57 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f Nov 02 11:03:57 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Acquiring lock "cinder-0dc79fd5-c341-4120-8f59-1752643af493-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "cinder-0dc79fd5-c341-4120-8f59-1752643af493-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:57 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:57 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b Nov 02 11:03:57 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Acquiring lock "cinder-quobyte-0dc79fd5-c341-4120-8f59-1752643af493" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "cinder-quobyte-0dc79fd5-c341-4120-8f59-1752643af493" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ef23c-5068-4d7e-ba52-b15968a8652a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:57 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:57 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 1G Nov 02 11:03:57 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:57 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 Nov 02 11:03:57 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:58 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b Nov 02 11:03:58 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:58 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493 Nov 02 11:03:58 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f.d5784bde-0a5f-438e-8c28-fb9ffa77370b" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 1G" returned: 0 in 0.455s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529fda04-1b68-41b3-9016-678e9e44c77f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:58 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529fda04-1b68-41b3-9016-678e9e44c77f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 Nov 02 11:03:58 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-d5784bde-0a5f-438e-8c28-fb9ffa77370b" released by "_delete_snapshot" :: held 1.584s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" released by "delete_snapshot" :: held 1.616s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Created reservations ['941ffe68-3341-4d2b-8592-63c682a1b9fd', 'cd16e7db-602c-4305-9e00-0151811f3ceb', '96565058-0fa3-4c1d-a10b-46ea6317204b', '9e97373a-e8bc-40c0-99b1-2b3d7b3dec5f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:58 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-0dc79fd5-c341-4120-8f59-1752643af493" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "cinder-quobyte-0dc79fd5-c341-4120-8f59-1752643af493" released by "delete_volume" :: held 0.737s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Delete snapshot completed successfully. Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa3d5289-ba51-4f0a-8170-1632cc95e6eb tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-d5784bde-0a5f-438e-8c28-fb9ffa77370b-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Created reservations ['1b78b7f6-c9e2-4c9f-bba9-c8529e0fbead', '96b115d3-b93b-4973-85f6-1affa4b8d214', 'de442223-7138-428e-81cc-30606f85638c', 'b982fad5-04bf-4f96-88ef-abeb92fa354e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:58 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:03:58 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529fda04-1b68-41b3-9016-678e9e44c77f -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 is being set with open permissions: ugo+rw Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:58 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 Nov 02 11:03:58 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:58 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-cfc8ef05-d5e1-44e8-97a0-197334e2da9f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:03:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Deleted volume successfully. Nov 02 11:03:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-cfc8ef05-d5e1-44e8-97a0-197334e2da9f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fdeb91e0-abe2-498b-b88f-98f88fac8564 tempest-ProjectReaderTests-484658179 None] Lock "cinder-0dc79fd5-c341-4120-8f59-1752643af493-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:59 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info Nov 02 11:03:59 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80bbd74-fa1d-45a6-864f-600d377100cf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:59 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f Nov 02 11:03:59 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:59 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:59 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info is being set with open permissions: ugo+rw Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:59 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info Nov 02 11:03:59 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:59 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.info" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:59 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" returned: 0 in 0.478s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:03:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f888da30-dd1b-4ce7-a4f5-12ed21d3c016 tempest-ProjectReaderTests-1133394238 None] Create snapshot completed successfully Nov 02 11:03:59 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f Nov 02 11:03:59 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:03:59 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-cfc8ef05-d5e1-44e8-97a0-197334e2da9f" released by "delete_volume" :: held 0.841s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:03:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Created reservations ['270c18e0-4640-47bf-8902-773dec0d2a5f', 'd0a98ec4-d64c-4fc0-9807-20dcfd390801', '0f1e3be0-557c-4e56-90df-3c24ee0c9b79', 'bd7f5e9a-27e9-4a98-84ec-17e6c1a0f541'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:00 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:00 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-10bdd639-9a73-437d-b252-fb6edd43a165-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-10bdd639-9a73-437d-b252-fb6edd43a165-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "cinder-quobyte-10bdd639-9a73-437d-b252-fb6edd43a165" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-10bdd639-9a73-437d-b252-fb6edd43a165" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c21a22-ce2a-490e-93d8-299c6c7e3ebf]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:00 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Deleted volume successfully. Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c55e3df7-b4f9-4ff5-b707-c206385b92b0 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-cfc8ef05-d5e1-44e8-97a0-197334e2da9f-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:00 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 Nov 02 11:04:00 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-355c4671-dea1-4c3b-8f50-d20ab8750500-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-355c4671-dea1-4c3b-8f50-d20ab8750500-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-355c4671-dea1-4c3b-8f50-d20ab8750500" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-355c4671-dea1-4c3b-8f50-d20ab8750500" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Deleting offline snapshot 355c4671-dea1-4c3b-8f50-d20ab8750500 of volume 529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] snapshot_file for this snap is: volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ca1cd-62e8-45a8-a5c7-44f3b7539a2a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:00 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165" returned: 0 in 0.444s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:00 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165 Nov 02 11:04:00 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:00 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 Nov 02 11:04:00 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:00 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-10bdd639-9a73-437d-b252-fb6edd43a165" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-quobyte-10bdd639-9a73-437d-b252-fb6edd43a165" released by "delete_volume" :: held 0.767s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Created reservations ['254216c8-9185-4791-b45b-c71178b21ca7', '55ab0a12-6213-46e7-b754-4a221a71b90e', '41300321-0f58-480f-b15f-4d298fa75d46', '8b35b412-6371-43ad-b124-54162783b614'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:01 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-529fda04-1b68-41b3-9016-678e9e44c77f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b674f17-18ea-4027-a1df-8a53d2496577]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:01 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:01 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:01 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f Nov 02 11:04:01 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:01 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Deleted volume successfully. Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1bc4cff5-fdb3-4d5b-95f7-41c9072832a5 tempest-CinderUnicodeTest-1194085769 None] Lock "cinder-10bdd639-9a73-437d-b252-fb6edd43a165-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:01 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:01 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 Nov 02 11:04:01 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:01 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:01 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500 Nov 02 11:04:01 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:02 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f.355c4671-dea1-4c3b-8f50-d20ab8750500" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-355c4671-dea1-4c3b-8f50-d20ab8750500" released by "_delete_snapshot" :: held 1.627s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" released by "delete_snapshot" :: held 1.655s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Created reservations ['a8cfb69a-e5ca-418a-a973-c558d6bfee09', 'f0d1e6e7-fab6-470b-b4f0-95fd7f33c286', '4ea14f9c-4ea3-4bd7-97e3-818a687d0000', '3c9f8763-5686-45e5-9e46-d49a6b5b9d32'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Delete snapshot completed successfully. Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0a882b4-d2b2-4b9d-aa06-0ede55988902 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-355c4671-dea1-4c3b-8f50-d20ab8750500-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-529fda04-1b68-41b3-9016-678e9e44c77f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-529fda04-1b68-41b3-9016-678e9e44c77f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0854a-2bbf-423a-8f69-f4d687460c10]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:03 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f Nov 02 11:04:03 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:03 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:03 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f Nov 02 11:04:03 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:03 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-529fda04-1b68-41b3-9016-678e9e44c77f" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-quobyte-529fda04-1b68-41b3-9016-678e9e44c77f" released by "delete_volume" :: held 0.779s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Created reservations ['8d5356c6-7b61-46be-9761-cbe66624c5e0', 'b6c942db-b4fb-4166-acd0-748bdbbbda25', '9d0f0f20-9bab-4789-8632-6b7b3ad3941b', 'e65dabcb-06d2-43a3-9c99-f008c1247ef3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:03 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:03 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:04 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:04 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Deleted volume successfully. Nov 02 11:04:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-288f6ceb-0272-4f45-9908-b8d1aa7b72a5 tempest-ProjectReaderTests-1133394238 None] Lock "cinder-529fda04-1b68-41b3-9016-678e9e44c77f-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:09 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:09 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:09 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (1f9ec364-5e50-4241-8ec8-82fdd86447b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2273ef-7700-4ae5-8112-7ea3e157ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2273ef-7700-4ae5-8112-7ea3e157ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822149586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bd081e-cdc3-4964-b1c2-6abb95f06434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:10Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c29590-9b48-4d0c-ac59-ef5354df2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c29590-9b48-4d0c-ac59-ef5354df2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e40d3b-40c4-48dd-9a3c-8b51e90858c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e40d3b-40c4-48dd-9a3c-8b51e90858c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3bd081e-cdc3-4964-b1c2-6abb95f06434', 'volume_name': 'volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c123e5e6-6a2a-4cc4-b944-e1a2991ac29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c123e5e6-6a2a-4cc4-b944-e1a2991ac29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8298a27-e11a-48ca-acde-762223258d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Volume b3bd081e-cdc3-4964-b1c2-6abb95f06434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434', 'volume_size': 1} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822149586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3bd081e-cdc3-4964-b1c2-6abb95f06434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:10Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Creating volume b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:10 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:10 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 1073741824 Nov 02 11:04:10 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:10 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 1073741824" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:10 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 Nov 02 11:04:10 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:11 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8298a27-e11a-48ca-acde-762223258d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280ae72b-0f3d-4a46-8fd6-46eb6ced495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Volume volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 (b3bd081e-cdc3-4964-b1c2-6abb95f06434): created successfully Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280ae72b-0f3d-4a46-8fd6-46eb6ced495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (1f9ec364-5e50-4241-8ec8-82fdd86447b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a46b9ca0-77da-4cf7-bec7-f121b7bcce33 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot d0c9c40f-de4c-4b1f-b856-cc1cae048eca of volume b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[07267f3c-04a1-4d11-b0e0-f882e2531b75]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:11 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 Nov 02 11:04:11 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:12 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434" returned: 0 in 0.360s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:12 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca 1G Nov 02 11:04:12 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:12 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca 1G" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:12 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca Nov 02 11:04:12 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:12 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:12 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca is being set with open permissions: ugo+rw Nov 02 11:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:12 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca Nov 02 11:04:12 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:13 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info Nov 02 11:04:13 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:13 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info is being set with open permissions: ugo+rw Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:13 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info Nov 02 11:04:13 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:13 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.info" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4b5f1e55-0e29-4939-a7ac-19ef9a4aab03 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-d0c9c40f-de4c-4b1f-b856-cc1cae048eca-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-d0c9c40f-de4c-4b1f-b856-cc1cae048eca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-d0c9c40f-de4c-4b1f-b856-cc1cae048eca" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-d0c9c40f-de4c-4b1f-b856-cc1cae048eca" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot d0c9c40f-de4c-4b1f-b856-cc1cae048eca of volume b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ae507-bf70-4312-95ec-d4e0ad9ff2d3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:14 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca Nov 02 11:04:14 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:14 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee6286-3fbd-4e2f-a2df-22e987669707]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:14 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 Nov 02 11:04:14 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:14 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:14 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca Nov 02 11:04:14 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:15 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:15 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca Nov 02 11:04:15 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:15 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434.d0c9c40f-de4c-4b1f-b856-cc1cae048eca" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-d0c9c40f-de4c-4b1f-b856-cc1cae048eca" released by "_delete_snapshot" :: held 1.525s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" released by "delete_snapshot" :: held 1.561s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Created reservations ['aae9ae10-8538-4008-9e24-fcc1a6316906', 'f72b1b4d-7e1b-494c-9281-f5aeb4f7c951', 'eebbaba3-328b-48e4-bc24-0ef1939fe543', '3b6a5514-d087-4a2d-9f9c-17f3057da620'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c207e7eb-eb94-4f31-865b-4dacc0c9ef6b tempest-ProjectMemberTests-312285986 None] Lock "cinder-d0c9c40f-de4c-4b1f-b856-cc1cae048eca-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-b3bd081e-cdc3-4964-b1c2-6abb95f06434-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "cinder-b3bd081e-cdc3-4964-b1c2-6abb95f06434-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[22763093-d036-403c-8cea-88801e946627]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:16 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 Nov 02 11:04:16 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:16 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:16 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434 Nov 02 11:04:16 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:16 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b3bd081e-cdc3-4964-b1c2-6abb95f06434" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-b3bd081e-cdc3-4964-b1c2-6abb95f06434" released by "delete_volume" :: held 0.699s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Created reservations ['13b665e9-6169-435d-8a6f-e8e769d8125a', 'aba31266-593a-4741-99d3-cd7407f06025', '8395be72-2e9f-4ad4-9938-9e103fa4fff8', '64eb7d1d-fe8d-48f4-a1c6-4b070ce4f062'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:16 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:16 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:17 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3ea7efa6-4d60-482f-bcb3-c0fafbc1746a tempest-ProjectMemberTests-312285986 None] Lock "cinder-b3bd081e-cdc3-4964-b1c2-6abb95f06434-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (7c60462a-d714-455d-bb9e-42640016aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7c72b-6bcb-455f-8795-f538daa547dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b7c72b-6bcb-455f-8795-f538daa547dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433802868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e84f47-1e48-417c-ac98-020875824297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:18Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f330ebd-b942-4fe3-858e-93e0311da01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f330ebd-b942-4fe3-858e-93e0311da01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde3ff7-3fcd-46a5-a4f3-b6eb628945f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde3ff7-3fcd-46a5-a4f3-b6eb628945f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e84f47-1e48-417c-ac98-020875824297', 'volume_name': 'volume-a2e84f47-1e48-417c-ac98-020875824297', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad2fb56-1063-4dad-bccf-913635103b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad2fb56-1063-4dad-bccf-913635103b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee3a98a-a07f-47fb-9999-8fe1e2a0fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Volume a2e84f47-1e48-417c-ac98-020875824297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e84f47-1e48-417c-ac98-020875824297', 'volume_size': 1} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1433802868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e84f47-1e48-417c-ac98-020875824297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:18Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Creating volume a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:17 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:17 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 1073741824 Nov 02 11:04:17 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:18 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 1073741824" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:18 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 Nov 02 11:04:18 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:18 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee3a98a-a07f-47fb-9999-8fe1e2a0fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e84f47-1e48-417c-ac98-020875824297', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea8dade-17f8-4c78-a40c-a020d070a687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Volume volume-a2e84f47-1e48-417c-ac98-020875824297 (a2e84f47-1e48-417c-ac98-020875824297): created successfully Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea8dade-17f8-4c78-a40c-a020d070a687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (7c60462a-d714-455d-bb9e-42640016aac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-de9382eb-815e-4769-a9e0-6b7b151675dd tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot 38075411-196a-4543-9d16-2f9beb225103 of volume a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[695a67e5-a16f-4069-b297-a87ccbfc791b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:18 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 Nov 02 11:04:18 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:19 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:19 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 1G Nov 02 11:04:19 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:19 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 1G" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e84f47-1e48-417c-ac98-020875824297 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:19 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e84f47-1e48-417c-ac98-020875824297 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 Nov 02 11:04:19 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:19 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e84f47-1e48-417c-ac98-020875824297 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:19 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 is being set with open permissions: ugo+rw Nov 02 11:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:19 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 Nov 02 11:04:19 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:20 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:20 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info Nov 02 11:04:20 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:20 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:20 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info is being set with open permissions: ugo+rw Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:20 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info Nov 02 11:04:20 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:20 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.info" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8bfd4b8a-33ad-4909-8c5b-85916f204285 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-38075411-196a-4543-9d16-2f9beb225103-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-38075411-196a-4543-9d16-2f9beb225103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-38075411-196a-4543-9d16-2f9beb225103" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-38075411-196a-4543-9d16-2f9beb225103" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot 38075411-196a-4543-9d16-2f9beb225103 of volume a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb43a19-a77f-47a6-a0c5-402a46f42267]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:21 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 Nov 02 11:04:21 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:21 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e84f47-1e48-417c-ac98-020875824297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad57693-2138-430f-9f70-81e4d0015a61]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:21 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 Nov 02 11:04:21 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:21 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:21 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 Nov 02 11:04:21 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:22 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:22 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103 Nov 02 11:04:22 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:22 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297.38075411-196a-4543-9d16-2f9beb225103" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-38075411-196a-4543-9d16-2f9beb225103" released by "_delete_snapshot" :: held 1.435s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" released by "delete_snapshot" :: held 1.459s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Created reservations ['b8af25d6-1dc0-43bc-8da3-2ac0a2f7ec2b', '45930b30-8731-45f9-a90a-9236b2a3fb6a', 'da507589-fc98-4a25-926d-a31a06119006', '1aa027d8-e226-4a82-a3e2-5e1cd7dee273'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e01af361-514e-4735-97f3-b74366041f10 tempest-ProjectMemberTests-312285986 None] Lock "cinder-38075411-196a-4543-9d16-2f9beb225103-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-a2e84f47-1e48-417c-ac98-020875824297-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "cinder-a2e84f47-1e48-417c-ac98-020875824297-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[97079e72-dc6a-4f2e-98c0-03c54198b1c3]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:23 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 Nov 02 11:04:23 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:23 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297" returned: 0 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:23 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297 Nov 02 11:04:23 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:23 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-a2e84f47-1e48-417c-ac98-020875824297" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-a2e84f47-1e48-417c-ac98-020875824297" released by "delete_volume" :: held 0.722s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Created reservations ['cfd02374-610b-483c-b4a7-a19a26a583ec', 'f7249d00-6724-40d9-bce7-60402f15dc8c', '5628b3e4-d899-4a6a-939f-90cff9f17b13', '1347643c-963c-4dd4-b73e-1e6974cbd9c4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:24 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:24 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:24 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7bfc4c21-19de-4083-84ef-cf632b6e9c00 tempest-ProjectMemberTests-312285986 None] Lock "cinder-a2e84f47-1e48-417c-ac98-020875824297-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (0d8c6dad-3f3c-421e-a38f-c4d7beed2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078fad43-df3d-4b16-8202-b52df0fb5f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078fad43-df3d-4b16-8202-b52df0fb5f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688009078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746de067-0b2b-493d-ae1f-0529a2284c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:25Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d817d0d6-dab2-4064-b0cf-3cfb1b30e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d817d0d6-dab2-4064-b0cf-3cfb1b30e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52aa57c6-2146-4989-9575-76d472d3c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52aa57c6-2146-4989-9575-76d472d3c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746de067-0b2b-493d-ae1f-0529a2284c09', 'volume_name': 'volume-746de067-0b2b-493d-ae1f-0529a2284c09', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac35a01-9b65-4918-a6d3-47efb75a1e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac35a01-9b65-4918-a6d3-47efb75a1e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35eac308-2709-4b88-aedd-d34e5d418420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Volume 746de067-0b2b-493d-ae1f-0529a2284c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746de067-0b2b-493d-ae1f-0529a2284c09', 'volume_size': 1} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688009078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746de067-0b2b-493d-ae1f-0529a2284c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:25Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Creating volume 746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:24 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 1073741824 Nov 02 11:04:24 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:25 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 1073741824" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:25 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 Nov 02 11:04:25 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:25 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35eac308-2709-4b88-aedd-d34e5d418420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746de067-0b2b-493d-ae1f-0529a2284c09', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59303c3e-5d93-467c-8ffc-fc1aa8801c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Volume volume-746de067-0b2b-493d-ae1f-0529a2284c09 (746de067-0b2b-493d-ae1f-0529a2284c09): created successfully Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59303c3e-5d93-467c-8ffc-fc1aa8801c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (0d8c6dad-3f3c-421e-a38f-c4d7beed2c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5e41e2ea-3fdc-441b-899d-ed98ab8db9e9 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot 2ff828d3-3a01-4aff-b9a6-1d1a149b6424 of volume 746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1978f9a-c199-4347-afb5-cb77caf6fc12]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:27 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 Nov 02 11:04:27 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:27 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:27 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 1G Nov 02 11:04:27 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:27 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 1G" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746de067-0b2b-493d-ae1f-0529a2284c09 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:27 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746de067-0b2b-493d-ae1f-0529a2284c09 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 Nov 02 11:04:27 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:28 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-746de067-0b2b-493d-ae1f-0529a2284c09 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 is being set with open permissions: ugo+rw Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:28 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 Nov 02 11:04:28 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:28 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:28 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info Nov 02 11:04:28 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:28 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info is being set with open permissions: ugo+rw Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:28 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info Nov 02 11:04:28 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:28 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.info" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-80d57db0-174c-4d39-a4a7-43518d423222 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-2ff828d3-3a01-4aff-b9a6-1d1a149b6424-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-2ff828d3-3a01-4aff-b9a6-1d1a149b6424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-2ff828d3-3a01-4aff-b9a6-1d1a149b6424" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2ff828d3-3a01-4aff-b9a6-1d1a149b6424" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot 2ff828d3-3a01-4aff-b9a6-1d1a149b6424 of volume 746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231f745-f138-4331-b6d6-c918ece7c8c1]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:29 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 Nov 02 11:04:29 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:29 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-746de067-0b2b-493d-ae1f-0529a2284c09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd12fa7-70dd-43ef-9f82-86f9d2331633]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:29 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 Nov 02 11:04:29 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (170616c7-c874-4ae9-9ea5-eb211804a18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d90d2ee-d982-4df0-8cd3-68131b9313ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d90d2ee-d982-4df0-8cd3-68131b9313ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62040086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ed8bae-28e1-4332-8a0f-53f5be282a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:30Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2eab43b-f227-4eb5-8035-94df22de6de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2eab43b-f227-4eb5-8035-94df22de6de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77f332-33a8-43db-acb3-ee0e779429cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77f332-33a8-43db-acb3-ee0e779429cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ed8bae-28e1-4332-8a0f-53f5be282a02', 'volume_name': 'volume-57ed8bae-28e1-4332-8a0f-53f5be282a02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959568e9-d072-422f-a00d-943278a4697c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959568e9-d072-422f-a00d-943278a4697c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7957649b-cd13-4477-bc55-369d57c4aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Volume 57ed8bae-28e1-4332-8a0f-53f5be282a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ed8bae-28e1-4332-8a0f-53f5be282a02', 'volume_size': 1} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62040086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ed8bae-28e1-4332-8a0f-53f5be282a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:30Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Creating volume 57ed8bae-28e1-4332-8a0f-53f5be282a02 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:30 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:30 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 1073741824 Nov 02 11:04:30 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:30 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 Nov 02 11:04:30 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:30 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:30 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424 Nov 02 11:04:30 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:30 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 1073741824" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:30 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 Nov 02 11:04:30 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:30 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09.2ff828d3-3a01-4aff-b9a6-1d1a149b6424" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2ff828d3-3a01-4aff-b9a6-1d1a149b6424" released by "_delete_snapshot" :: held 1.450s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" released by "delete_snapshot" :: held 1.472s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:30 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Created reservations ['beb0e64f-e05e-4395-9683-8a8d17140e08', '1fd8bd35-6dd9-4221-bc7f-32f156e4ca29', 'e093cb5b-ef11-40f0-ba94-93ef8f93a01a', 'b4bbbe34-fb67-4140-b372-49b6f9d99e74'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7957649b-cd13-4477-bc55-369d57c4aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ed8bae-28e1-4332-8a0f-53f5be282a02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc16022-4aec-4f0b-aca8-97a6e68463c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Volume volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 (57ed8bae-28e1-4332-8a0f-53f5be282a02): created successfully Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc16022-4aec-4f0b-aca8-97a6e68463c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (170616c7-c874-4ae9-9ea5-eb211804a18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-16cad10e-95ae-4dd2-9202-2fe4576d0d55 tempest-ProjectReaderTests-1840500808 None] Created volume successfully. Nov 02 11:04:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-232981c5-8456-465a-9eff-6d417390c11e tempest-ProjectMemberTests-312285986 None] Lock "cinder-2ff828d3-3a01-4aff-b9a6-1d1a149b6424-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-57ed8bae-28e1-4332-8a0f-53f5be282a02-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-57ed8bae-28e1-4332-8a0f-53f5be282a02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-quobyte-57ed8bae-28e1-4332-8a0f-53f5be282a02" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-57ed8bae-28e1-4332-8a0f-53f5be282a02" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fe9d16-2446-496b-a6ce-7d8453ef37aa]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:31 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 Nov 02 11:04:31 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-746de067-0b2b-493d-ae1f-0529a2284c09-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "cinder-746de067-0b2b-493d-ae1f-0529a2284c09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3533e2-4678-46ed-986b-15a42b7f6ca7]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:31 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 Nov 02 11:04:31 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:31 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:31 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02 Nov 02 11:04:31 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:31 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:31 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-57ed8bae-28e1-4332-8a0f-53f5be282a02" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:31 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09 Nov 02 11:04:31 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-57ed8bae-28e1-4332-8a0f-53f5be282a02" released by "delete_volume" :: held 0.689s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Created reservations ['02e5b9d7-22d8-4373-9f56-423f1abc4548', '708827df-4290-467e-ab1c-991c8fa70cdd', 'd3ee5f92-0f4d-419f-a142-b5cc70373a9d', 'c0a9b685-6746-44ea-b1d8-50e2397baa27'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:31 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:31 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:32 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-746de067-0b2b-493d-ae1f-0529a2284c09" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-746de067-0b2b-493d-ae1f-0529a2284c09" released by "delete_volume" :: held 0.684s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Created reservations ['21b4ac04-2e9e-476e-8a0f-2a322754860d', '3980d342-c9f8-4e83-883a-3e341b648fe7', '81b2a6c5-d97a-467b-9d19-a65e4d4fd36f', 'b107863b-f27b-4b5c-bad8-cd7d5dd4fb49'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:32 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:32 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Deleted volume successfully. Nov 02 11:04:32 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-12ee7acb-f79f-40f7-81c0-de7f65754ad2 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-57ed8bae-28e1-4332-8a0f-53f5be282a02-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:32 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1d1e30d4-65e2-4517-bbda-d3f3d4b0acc4 tempest-ProjectMemberTests-312285986 None] Lock "cinder-746de067-0b2b-493d-ae1f-0529a2284c09-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (eb8dae9e-6632-48c9-947b-83937915a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e8b8c-31b8-4fff-bcca-1700e22faabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e8b8c-31b8-4fff-bcca-1700e22faabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603040216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b24695-8898-4c49-baed-ef4c1e4f33c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:33Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ae36b7-9ddc-4cb1-9163-b8c412fea511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ae36b7-9ddc-4cb1-9163-b8c412fea511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6b44c-36b4-4e02-a110-f8cf84d1bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6b44c-36b4-4e02-a110-f8cf84d1bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b24695-8898-4c49-baed-ef4c1e4f33c2', 'volume_name': 'volume-25b24695-8898-4c49-baed-ef4c1e4f33c2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b2d46-5389-4d2f-bfdb-2b10c054983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204b2d46-5389-4d2f-bfdb-2b10c054983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464acbd4-09b8-4220-a237-09d7eeec6864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Volume 25b24695-8898-4c49-baed-ef4c1e4f33c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b24695-8898-4c49-baed-ef4c1e4f33c2', 'volume_size': 1} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603040216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b24695-8898-4c49-baed-ef4c1e4f33c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:33Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Creating volume 25b24695-8898-4c49-baed-ef4c1e4f33c2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:32 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:32 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 1073741824 Nov 02 11:04:32 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (81c6dae1-ce0a-4859-a3fa-f797adbf8ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8819eb-198b-40cb-97ec-aebe0d59c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8819eb-198b-40cb-97ec-aebe0d59c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47171258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387cd792-4f7d-4a52-ab4f-87dc2f15fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:33Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aec727-aad4-427d-afde-7b9da27c1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20aec727-aad4-427d-afde-7b9da27c1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5ae317-6b6d-471a-9bba-0144b7bd32c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5ae317-6b6d-471a-9bba-0144b7bd32c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387cd792-4f7d-4a52-ab4f-87dc2f15fc1e', 'volume_name': 'volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f4c513-df12-43ab-994a-ef01cb892a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f4c513-df12-43ab-994a-ef01cb892a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91483e9-83f1-484b-ad95-4d886813df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Volume 387cd792-4f7d-4a52-ab4f-87dc2f15fc1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e', 'volume_size': 1} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:33 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 1073741824" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:33 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 Nov 02 11:04:33 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:33 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47171258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387cd792-4f7d-4a52-ab4f-87dc2f15fc1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:33Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Creating volume 387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:33 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464acbd4-09b8-4220-a237-09d7eeec6864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b24695-8898-4c49-baed-ef4c1e4f33c2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e 1073741824 Nov 02 11:04:33 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd2259-67f4-4c4e-8a9f-4c3f460408da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Volume volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 (25b24695-8898-4c49-baed-ef4c1e4f33c2): created successfully Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd2259-67f4-4c4e-8a9f-4c3f460408da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (eb8dae9e-6632-48c9-947b-83937915a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1bc62848-faef-408f-9f85-074af1e23c51 tempest-ProjectReaderTests-1840500808 None] Created volume successfully. Nov 02 11:04:33 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e 1073741824" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:34 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e Nov 02 11:04:34 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:34 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91483e9-83f1-484b-ad95-4d886813df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd02c7a8-dadd-44fb-b9f0-36be5a2bbdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Volume volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e (387cd792-4f7d-4a52-ab4f-87dc2f15fc1e): created successfully Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd02c7a8-dadd-44fb-b9f0-36be5a2bbdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (81c6dae1-ce0a-4859-a3fa-f797adbf8ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba9c5f32-f95c-40fa-b47b-11f963636654 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-25b24695-8898-4c49-baed-ef4c1e4f33c2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "cinder-25b24695-8898-4c49-baed-ef4c1e4f33c2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-quobyte-25b24695-8898-4c49-baed-ef4c1e4f33c2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-25b24695-8898-4c49-baed-ef4c1e4f33c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf8e54-4ed3-44f6-86ec-0ab7f55838a9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:35 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 Nov 02 11:04:35 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Creating offline snapshot e628b352-9a6b-4ef3-8144-7c0e66aef76c of volume 387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3516d7ce-9265-4971-89ca-781fe17f70b2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:35 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e Nov 02 11:04:35 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:35 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:35 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2 Nov 02 11:04:35 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:35 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-25b24695-8898-4c49-baed-ef4c1e4f33c2" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:35 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-25b24695-8898-4c49-baed-ef4c1e4f33c2" released by "delete_volume" :: held 0.677s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:35 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c 1G Nov 02 11:04:35 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Created reservations ['0ffe7245-0ca1-4040-aca8-47deae1541b8', '44bd5a1f-93f7-401e-ae8a-57c73138c355', 'c8601f7f-b9f3-4499-9ab0-99c15fdbdf7e', 'a66742a3-52c5-43df-969b-2174f4956027'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:35 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:35 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:35 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Deleted volume successfully. Nov 02 11:04:35 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c 1G" returned: 0 in 0.427s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:36 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c Nov 02 11:04:36 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e198a61-99dd-4130-86fe-85bcbf10ff4b tempest-ProjectReaderTests-1840500808 None] Lock "cinder-25b24695-8898-4c49-baed-ef4c1e4f33c2-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:36 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c" returned: 0 in 0.321s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:36 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c is being set with open permissions: ugo+rw Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:36 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c Nov 02 11:04:36 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (4e7860df-481e-4473-ad85-1ef45673d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d3048d-e390-433b-8e16-d3957425b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d3048d-e390-433b-8e16-d3957425b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1644673560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe36d93-2057-4923-ad47-b767c94d37bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:36Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff43430-6900-4e88-8787-5f4c78eb3221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff43430-6900-4e88-8787-5f4c78eb3221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bf315-c0f6-41a7-96d9-3c4f0a54aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bf315-c0f6-41a7-96d9-3c4f0a54aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe36d93-2057-4923-ad47-b767c94d37bd', 'volume_name': 'volume-dfe36d93-2057-4923-ad47-b767c94d37bd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5776cb-68aa-4b35-8d70-b9d32a809952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5776cb-68aa-4b35-8d70-b9d32a809952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ab120b-af64-43fe-90d8-e716744c5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Volume dfe36d93-2057-4923-ad47-b767c94d37bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe36d93-2057-4923-ad47-b767c94d37bd', 'volume_size': 1} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:36 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:36 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info Nov 02 11:04:36 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:36 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:36 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info is being set with open permissions: ugo+rw Nov 02 11:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:36 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info Nov 02 11:04:36 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:37 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.info" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1644673560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe36d93-2057-4923-ad47-b767c94d37bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:36Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Creating volume dfe36d93-2057-4923-ad47-b767c94d37bd {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:37 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:37 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd 1073741824 Nov 02 11:04:37 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-28a33d8f-efd5-44d8-b6d1-e2483396a0df tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-e628b352-9a6b-4ef3-8144-7c0e66aef76c-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-e628b352-9a6b-4ef3-8144-7c0e66aef76c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-e628b352-9a6b-4ef3-8144-7c0e66aef76c" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-e628b352-9a6b-4ef3-8144-7c0e66aef76c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot e628b352-9a6b-4ef3-8144-7c0e66aef76c of volume 387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a433af-c509-4df7-819d-48974b31c053]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:37 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c Nov 02 11:04:37 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:37 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd 1073741824" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:37 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd Nov 02 11:04:37 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:37 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16837d-088e-48cb-a659-66af0cfdeb0c]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:37 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ab120b-af64-43fe-90d8-e716744c5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe36d93-2057-4923-ad47-b767c94d37bd', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812d5e57-7752-4e4c-b35e-b2362ee987dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Volume volume-dfe36d93-2057-4923-ad47-b767c94d37bd (dfe36d93-2057-4923-ad47-b767c94d37bd): created successfully Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812d5e57-7752-4e4c-b35e-b2362ee987dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (4e7860df-481e-4473-ad85-1ef45673d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4a6923b7-ceb4-461c-b55b-fc4352da899d tempest-ProjectReaderTests-1840500808 None] Created volume successfully. Nov 02 11:04:37 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e Nov 02 11:04:37 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:38 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:38 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c Nov 02 11:04:38 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:38 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:38 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c Nov 02 11:04:38 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-dfe36d93-2057-4923-ad47-b767c94d37bd-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-dfe36d93-2057-4923-ad47-b767c94d37bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-quobyte-dfe36d93-2057-4923-ad47-b767c94d37bd" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-dfe36d93-2057-4923-ad47-b767c94d37bd" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c4f393-8a11-4652-9bfb-94b9e944832a]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:38 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e.e628b352-9a6b-4ef3-8144-7c0e66aef76c" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-e628b352-9a6b-4ef3-8144-7c0e66aef76c" released by "_delete_snapshot" :: held 1.456s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" released by "delete_snapshot" :: held 1.484s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:38 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd Nov 02 11:04:38 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Created reservations ['facb2291-040a-41e7-a2f8-dc6b4cb49ee8', 'bb41bad7-606a-4321-bcc2-2452b13c9f7c', 'c9bc86d3-681d-4c16-a5c5-a18b6d8537b3', '2508b73d-4ec8-469a-8363-57c0f3cc56a2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1f4de76-e5dd-4a55-baac-ac9c15aa8e4f tempest-ProjectMemberTests-312285986 None] Lock "cinder-e628b352-9a6b-4ef3-8144-7c0e66aef76c-delete_snapshot" released by "delete_snapshot" :: held 1.633s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:39 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:39 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd Nov 02 11:04:39 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:39 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-dfe36d93-2057-4923-ad47-b767c94d37bd" returned: 0 in 0.233s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-dfe36d93-2057-4923-ad47-b767c94d37bd" released by "delete_volume" :: held 0.657s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Created reservations ['6467a320-86c8-42f5-b14d-6ff3d25f3a37', '1bb27e9e-3887-4e99-b750-729cba0960f2', '41920667-a05b-4ed5-9670-daca24ae678e', '92cf9c29-4997-4ae9-a85a-ff44043d4f52'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "cinder-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:39 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:39 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[913428cf-6f03-4df5-9639-365584088f1f]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:39 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e Nov 02 11:04:39 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:39 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Deleted volume successfully. Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-beb6d9f8-0c3f-49a6-b2bd-867d8fd4ea76 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-dfe36d93-2057-4923-ad47-b767c94d37bd-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:39 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:39 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e Nov 02 11:04:39 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:40 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (01b53c5f-1287-4197-ad48-1afa37ed06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63444fea-b30e-4b57-9ec5-823df721f06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63444fea-b30e-4b57-9ec5-823df721f06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044546655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d0523-b45f-424a-81d4-8fba6bcde16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:40Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ac1550-eb62-42bb-9c7d-3ecc7f57c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ac1550-eb62-42bb-9c7d-3ecc7f57c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5e7473-2b71-444a-89c9-bf1b4a814b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5e7473-2b71-444a-89c9-bf1b4a814b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08d0523-b45f-424a-81d4-8fba6bcde16c', 'volume_name': 'volume-b08d0523-b45f-424a-81d4-8fba6bcde16c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4d3753-8c2b-45fd-b01d-baa65293aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4d3753-8c2b-45fd-b01d-baa65293aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687ed78-1046-4831-b7f2-4c1540f6b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Volume b08d0523-b45f-424a-81d4-8fba6bcde16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08d0523-b45f-424a-81d4-8fba6bcde16c', 'volume_size': 1} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044546655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08d0523-b45f-424a-81d4-8fba6bcde16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4823b933bae46df8fd6aa53b0961cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:40Z,use_quota=True,user_id='769fb4b9fd3842d093a6f56b33c5cd77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Creating volume b08d0523-b45f-424a-81d4-8fba6bcde16c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e" released by "delete_volume" :: held 0.808s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:40 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c 1073741824 Nov 02 11:04:40 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Created reservations ['8822269a-c135-4f1c-aae0-8b8192a567be', '4f4d701e-8c10-41cf-9e58-da561da63e63', '7fe730dc-7060-4189-bf64-e502b6af2425', 'a16a77c7-94c4-4daf-8a37-952d99150f5d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:40 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:40 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:40 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-572408ea-0033-48b2-b72a-a16d4972f506 tempest-ProjectMemberTests-312285986 None] Lock "cinder-387cd792-4f7d-4a52-ab4f-87dc2f15fc1e-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:40 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c 1073741824" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:40 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c Nov 02 11:04:40 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:41 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (3b2be540-b1bd-4288-95e0-eeb49b4f9501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742d7a4d-5841-4714-886b-edd188fe011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742d7a4d-5841-4714-886b-edd188fe011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099156841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04d641d-c6e4-4c69-9ba8-a69cc3152794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:41Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab7317e-000b-4e7f-9b4c-d3ee729a402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab7317e-000b-4e7f-9b4c-d3ee729a402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7144d74d-8a8e-45ae-a9f4-fb5972d4eb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7144d74d-8a8e-45ae-a9f4-fb5972d4eb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04d641d-c6e4-4c69-9ba8-a69cc3152794', 'volume_name': 'volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22ce0f-c052-478e-9eef-1c877027b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22ce0f-c052-478e-9eef-1c877027b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a06841-ceef-4b30-8f08-92717fe18c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Volume c04d641d-c6e4-4c69-9ba8-a69cc3152794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794', 'volume_size': 1} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2099156841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04d641d-c6e4-4c69-9ba8-a69cc3152794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:41Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Creating volume c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687ed78-1046-4831-b7f2-4c1540f6b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08d0523-b45f-424a-81d4-8fba6bcde16c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34c88b2-b397-4173-be9b-23f32873240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 1073741824 Nov 02 11:04:41 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Volume volume-b08d0523-b45f-424a-81d4-8fba6bcde16c (b08d0523-b45f-424a-81d4-8fba6bcde16c): created successfully Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34c88b2-b397-4173-be9b-23f32873240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Flow 'volume_create_manager' (01b53c5f-1287-4197-ad48-1afa37ed06bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4db300e6-47d5-4ed7-9a7f-0095711dbcb2 tempest-ProjectReaderTests-1840500808 None] Created volume successfully. Nov 02 11:04:41 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 1073741824" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:41 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 Nov 02 11:04:41 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:41 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a06841-ceef-4b30-8f08-92717fe18c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0445949e-3362-4af8-b8de-e60cc2f2ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Volume volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 (c04d641d-c6e4-4c69-9ba8-a69cc3152794): created successfully Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0445949e-3362-4af8-b8de-e60cc2f2ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (3b2be540-b1bd-4288-95e0-eeb49b4f9501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2a87d4c5-4534-4c9b-829f-ff4010fcb641 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot 3e71e02a-4825-4ae8-a248-8ef602d5b135 of volume c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b9552b-0690-4020-a042-be72cc781bcd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-b08d0523-b45f-424a-81d4-8fba6bcde16c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-b08d0523-b45f-424a-81d4-8fba6bcde16c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "cinder-quobyte-b08d0523-b45f-424a-81d4-8fba6bcde16c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:42 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 Nov 02 11:04:42 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-b08d0523-b45f-424a-81d4-8fba6bcde16c" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0bf4b-c8f8-4305-83a8-bcca2a13c9a4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:42 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c Nov 02 11:04:42 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:42 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:42 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 1G Nov 02 11:04:42 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:42 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:42 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c Nov 02 11:04:42 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:43 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 1G" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:43 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 Nov 02 11:04:43 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:43 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-b08d0523-b45f-424a-81d4-8fba6bcde16c" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-quobyte-b08d0523-b45f-424a-81d4-8fba6bcde16c" released by "delete_volume" :: held 0.706s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Created reservations ['bb8f2419-6cb5-4958-b02a-d232f13501f3', 'ac5b2362-6fc7-4c20-b47a-0cb7f0f1b8e5', 'f46d75ab-9f4d-455d-b4d9-0e1f83e31661', '2c677536-3e2f-42ea-a2ad-9d2536a6a500'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:43 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:43 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:43 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 is being set with open permissions: ugo+rw Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:43 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 Nov 02 11:04:43 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:43 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Deleted volume successfully. Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d207b77-6483-44b3-8d29-7c4585b76849 tempest-ProjectReaderTests-1840500808 None] Lock "cinder-b08d0523-b45f-424a-81d4-8fba6bcde16c-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:43 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:43 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info Nov 02 11:04:43 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:43 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info is being set with open permissions: ugo+rw Nov 02 11:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:43 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info Nov 02 11:04:43 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:44 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.info" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-345d1828-4380-4011-9590-321402c88bb6 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-3e71e02a-4825-4ae8-a248-8ef602d5b135-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-3e71e02a-4825-4ae8-a248-8ef602d5b135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-3e71e02a-4825-4ae8-a248-8ef602d5b135" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3e71e02a-4825-4ae8-a248-8ef602d5b135" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot 3e71e02a-4825-4ae8-a248-8ef602d5b135 of volume c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55dfbf-3d50-488c-93b7-1d343befd186]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:44 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 Nov 02 11:04:44 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:44 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e893b6-6f08-470c-9329-42d4fdc84105]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:45 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 Nov 02 11:04:45 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:45 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:45 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 Nov 02 11:04:45 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:45 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:45 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135 Nov 02 11:04:45 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:45 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794.3e71e02a-4825-4ae8-a248-8ef602d5b135" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3e71e02a-4825-4ae8-a248-8ef602d5b135" released by "_delete_snapshot" :: held 1.477s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" released by "delete_snapshot" :: held 1.501s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Created reservations ['79f77ca6-2aef-4b59-87bb-a28458d29a80', '8de9dfb1-6399-4d2a-8de3-6e9d7ad26112', '5db947d5-a3b7-4efc-b1f2-257c9cbf7e41', 'b1e3994b-298a-4905-a287-d25a8b055233'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-28498813-7d5a-4594-a805-1c668fc3fd76 tempest-ProjectMemberTests-312285986 None] Lock "cinder-3e71e02a-4825-4ae8-a248-8ef602d5b135-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-c04d641d-c6e4-4c69-9ba8-a69cc3152794-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "cinder-c04d641d-c6e4-4c69-9ba8-a69cc3152794-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56340a-323e-48cf-afb6-a26aef9cf633]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:46 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 Nov 02 11:04:46 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:47 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:47 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794 Nov 02 11:04:47 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:47 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-c04d641d-c6e4-4c69-9ba8-a69cc3152794" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-c04d641d-c6e4-4c69-9ba8-a69cc3152794" released by "delete_volume" :: held 0.776s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Created reservations ['f4d1d579-8fb5-4089-912e-9194fc9b8d51', 'c7bc9942-55a6-40b3-a416-a8e0060b8226', '8f46fa8c-3e55-4372-9f26-61f4c70c1671', 'ff479dc4-b79c-44bb-854b-22e157f2db5f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:47 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:47 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:47 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e6ae4b46-4bd8-4ccb-842b-88b0b9facc2a tempest-ProjectMemberTests-312285986 None] Lock "cinder-c04d641d-c6e4-4c69-9ba8-a69cc3152794-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (d73a135b-af1b-4294-afdb-0c3c200c00c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a30a349-ffe5-4826-90ef-17753e6cd1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a30a349-ffe5-4826-90ef-17753e6cd1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229849000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:48Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edcc9f4-0960-402f-8415-022f8d07d3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edcc9f4-0960-402f-8415-022f8d07d3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d6bb0e-d9af-4588-b0cb-6542de72b224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d6bb0e-d9af-4588-b0cb-6542de72b224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee', 'volume_name': 'volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4856d09f-1882-4947-b02e-bab8261d46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4856d09f-1882-4947-b02e-bab8261d46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defd65c4-b980-4536-8aca-97020e75f780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Volume 4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee', 'volume_size': 1} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229849000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:48Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Creating volume 4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:48 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:48 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee 1073741824 Nov 02 11:04:48 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:48 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee 1073741824" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:48 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee Nov 02 11:04:48 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:49 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defd65c4-b980-4536-8aca-97020e75f780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6468c6-61e1-482b-b4da-d24bee9d1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Volume volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee (4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee): created successfully Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6468c6-61e1-482b-b4da-d24bee9d1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (d73a135b-af1b-4294-afdb-0c3c200c00c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3cbd1ebe-e726-4f8e-bc55-ce1606cf4dd6 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:DELETE=18,cinder:SELECT=168,cinder:UPDATE=230,cinder:INSERT=61 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=53,cinder:UPDATE=210,cinder:SELECT=159,cinder:DELETE=20 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Creating offline snapshot 1e897f80-2c49-44eb-adf7-63457f4970d1 of volume 4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e6f0ca-d44c-4fb0-a356-0f41cbeef1d9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:49 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee Nov 02 11:04:49 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:49 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:49 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 1G Nov 02 11:04:49 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:50 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 1G" returned: 0 in 0.527s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:50 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 Nov 02 11:04:50 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:50 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:50 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 is being set with open permissions: ugo+rw Nov 02 11:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:50 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 Nov 02 11:04:50 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:51 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:51 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info Nov 02 11:04:51 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:51 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:51 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info is being set with open permissions: ugo+rw Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:51 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info Nov 02 11:04:51 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:51 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.info" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c0036f12-ce2e-4b90-ab61-069c03d7b02a tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-1e897f80-2c49-44eb-adf7-63457f4970d1-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-1e897f80-2c49-44eb-adf7-63457f4970d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-1e897f80-2c49-44eb-adf7-63457f4970d1" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-1e897f80-2c49-44eb-adf7-63457f4970d1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot 1e897f80-2c49-44eb-adf7-63457f4970d1 of volume 4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e393b7f2-050a-4c4b-91f1-4d8a3a3b71e9]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:52 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 Nov 02 11:04:52 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:53 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d204c6-384c-4bda-9339-144de9b7aaa4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:53 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee Nov 02 11:04:53 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:53 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:53 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 Nov 02 11:04:53 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:53 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:53 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1 Nov 02 11:04:53 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:54 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee.1e897f80-2c49-44eb-adf7-63457f4970d1" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-1e897f80-2c49-44eb-adf7-63457f4970d1" released by "_delete_snapshot" :: held 1.481s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" released by "delete_snapshot" :: held 1.503s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Created reservations ['c8d680ac-64db-49c3-b5d7-c3ce98fc9992', '53aafefd-3abd-4dea-bba0-60871f970e30', '5ef450df-0319-44f7-b78f-b42966888e3a', '5be8da84-7f22-4f19-b26f-9882f529628a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37387c21-3557-4f53-b260-f3bfd2bc23b6 tempest-ProjectMemberTests-312285986 None] Lock "cinder-1e897f80-2c49-44eb-adf7-63457f4970d1-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "cinder-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b8537f-e79e-432a-840a-84f8961e1487]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:55 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee Nov 02 11:04:55 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:55 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:55 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee Nov 02 11:04:55 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:55 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee" released by "delete_volume" :: held 0.784s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Created reservations ['4e35909d-6067-4e3a-998e-e471babc4543', '4de3ccd0-7ac1-4c1d-a000-3f113a55e3f1', 'd959af4e-0d90-4752-8e56-ff8166d20cf3', 'c2b00c94-dd32-4c09-b473-929ecc309740'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:55 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:04:55 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:56 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:04:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3981435f-7833-4d59-94e8-da733f8df7c0 tempest-ProjectMemberTests-312285986 None] Lock "cinder-4f0a5e6f-8099-4f6c-8dac-44d804e8f4ee-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (6c9a640f-d3f0-4583-9efe-fb02ab0cc5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f7a2ed-bbcc-48b1-ad87-cada82101f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f7a2ed-bbcc-48b1-ad87-cada82101f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483191591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6cb65d-3004-4028-80a1-b5a4e27ec590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:57Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd99bd8-ecfa-4523-b755-92ea8b4c80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd99bd8-ecfa-4523-b755-92ea8b4c80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bcbca7-af1b-4b74-91ee-78c6e0653fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bcbca7-af1b-4b74-91ee-78c6e0653fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6cb65d-3004-4028-80a1-b5a4e27ec590', 'volume_name': 'volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5ff32c-81ff-4ce2-be06-15d815b64355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5ff32c-81ff-4ce2-be06-15d815b64355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e938a38d-d9c5-401c-b360-a21f8fc8950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Volume 4f6cb65d-3004-4028-80a1-b5a4e27ec590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590', 'volume_size': 1} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483191591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6cb65d-3004-4028-80a1-b5a4e27ec590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:04:57Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Creating volume 4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:04:56 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:56 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 1073741824 Nov 02 11:04:56 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:57 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 1073741824" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:57 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 Nov 02 11:04:57 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:57 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e938a38d-d9c5-401c-b360-a21f8fc8950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2924a355-3ef4-4086-aca2-ab920e96d8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:04:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Volume volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 (4f6cb65d-3004-4028-80a1-b5a4e27ec590): created successfully Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2924a355-3ef4-4086-aca2-ab920e96d8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (6c9a640f-d3f0-4583-9efe-fb02ab0cc5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:04:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c5bebd7e-bc4d-4b00-b24c-b6ce204e92e3 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Creating offline snapshot f3b29db3-30d6-46c3-93f4-3b5647c4cebb of volume 4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[021fe5f9-7e78-4d61-81ec-0bbc39fb6238]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:57 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 Nov 02 11:04:57 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:58 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:58 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb 1G Nov 02 11:04:58 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:58 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb 1G" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:58 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb Nov 02 11:04:58 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:58 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:58 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb is being set with open permissions: ugo+rw Nov 02 11:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:58 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb Nov 02 11:04:58 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:59 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:59 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info Nov 02 11:04:59 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:59 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:59 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info is being set with open permissions: ugo+rw Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:04:59 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info Nov 02 11:04:59 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:04:59 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.info" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:04:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b44100af-0932-4e56-86d6-62e74a13458a tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-f3b29db3-30d6-46c3-93f4-3b5647c4cebb-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-f3b29db3-30d6-46c3-93f4-3b5647c4cebb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-f3b29db3-30d6-46c3-93f4-3b5647c4cebb" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-f3b29db3-30d6-46c3-93f4-3b5647c4cebb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot f3b29db3-30d6-46c3-93f4-3b5647c4cebb of volume 4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:04:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47083b5-5b75-4811-9b7c-f8b8a2a2ca20]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:00 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb Nov 02 11:05:00 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:00 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[46594d2e-ce9e-4f5b-93fe-68fc608b85fd]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:00 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 Nov 02 11:05:00 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:00 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:00 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb Nov 02 11:05:00 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:01 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:01 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb Nov 02 11:05:01 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:01 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590.f3b29db3-30d6-46c3-93f4-3b5647c4cebb" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-f3b29db3-30d6-46c3-93f4-3b5647c4cebb" released by "_delete_snapshot" :: held 1.587s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" released by "delete_snapshot" :: held 1.617s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Created reservations ['140da9a5-a987-4962-a080-5ab6a0e9195e', '82668768-fea8-43d6-9903-0281d97936d1', 'f15c77da-24df-4fe1-99d7-3986f2c720b3', '3f7bd0f3-4668-4c93-b01c-943c17672b50'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3ed63c0-7cf4-4dbc-8ab3-351b4303aafe tempest-ProjectMemberTests-312285986 None] Lock "cinder-f3b29db3-30d6-46c3-93f4-3b5647c4cebb-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-4f6cb65d-3004-4028-80a1-b5a4e27ec590-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "cinder-4f6cb65d-3004-4028-80a1-b5a4e27ec590-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf54f9db-8012-4072-a294-5f2fccf7f371]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:02 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 Nov 02 11:05:02 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:02 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:02 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590 Nov 02 11:05:02 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:02 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-4f6cb65d-3004-4028-80a1-b5a4e27ec590" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-4f6cb65d-3004-4028-80a1-b5a4e27ec590" released by "delete_volume" :: held 0.738s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Created reservations ['7ce08427-5453-47bc-b30d-372f1d5dc318', 'ab760815-4e08-4154-a82d-d11a03256fb3', '6132aa8d-9c66-4bed-b936-5810cae84e15', '949212c8-5979-4e1f-b4fb-2a1f2da839a7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:03 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:03 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:03 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e57f78de-0085-4239-a298-e91f0153cc61 tempest-ProjectMemberTests-312285986 None] Lock "cinder-4f6cb65d-3004-4028-80a1-b5a4e27ec590-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (d649f1e9-043e-4fcd-b115-cf7fb32b77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc04b0c1-dada-40fe-840b-faf2a43e62cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc04b0c1-dada-40fe-840b-faf2a43e62cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974208298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92c263-8b94-4adc-b353-c3c1bf00e258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:04Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd9a074-076e-4dd5-982e-e83949f400e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd9a074-076e-4dd5-982e-e83949f400e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be55c8f0-4ff5-43fd-ad86-a3eec3ade933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be55c8f0-4ff5-43fd-ad86-a3eec3ade933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f92c263-8b94-4adc-b353-c3c1bf00e258', 'volume_name': 'volume-2f92c263-8b94-4adc-b353-c3c1bf00e258', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3538543c-cfeb-4293-86d0-ec4bc71d592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3538543c-cfeb-4293-86d0-ec4bc71d592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f467f091-f68e-4a15-a4db-fda5d20b47b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Volume 2f92c263-8b94-4adc-b353-c3c1bf00e258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f92c263-8b94-4adc-b353-c3c1bf00e258', 'volume_size': 1} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1974208298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92c263-8b94-4adc-b353-c3c1bf00e258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:04Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Creating volume 2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:05:03 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:03 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 1073741824 Nov 02 11:05:03 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:04 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 1073741824" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:04 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 Nov 02 11:05:04 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:04 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f467f091-f68e-4a15-a4db-fda5d20b47b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f92c263-8b94-4adc-b353-c3c1bf00e258', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c079ff8-e915-4f78-b28f-5c56ca2ca893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Volume volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 (2f92c263-8b94-4adc-b353-c3c1bf00e258): created successfully Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c079ff8-e915-4f78-b28f-5c56ca2ca893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (d649f1e9-043e-4fcd-b115-cf7fb32b77a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-52408506-8e31-411f-a70c-1b4694e00361 tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot f7c1f347-2696-425a-8ef1-6a7e68d47a69 of volume 2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7d4fa-44e7-4120-882b-c8b75000e513]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:05 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 Nov 02 11:05:05 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:05 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:05 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 1G Nov 02 11:05:05 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:06 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 1G" returned: 0 in 0.531s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:06 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 Nov 02 11:05:06 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:06 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:06 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 is being set with open permissions: ugo+rw Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:06 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 Nov 02 11:05:06 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:06 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Flow 'volume_create_manager' (79f782a5-5606-4243-9cde-bfff56718f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc9cfc6-1920-4f3e-ad88-934301d2920a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc9cfc6-1920-4f3e-ad88-934301d2920a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302284233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52c7ed-6dae-45c8-bb09-2180ea3debd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25874e4e2b414870baee6808787cdf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:07Z,use_quota=True,user_id='4f4acb3c6aa347e98bc8f0da8c5f542a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc2ef7f-d2f2-40e4-b296-b170d15adbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc2ef7f-d2f2-40e4-b296-b170d15adbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212b3a53-492b-40ee-acb0-b9cac161be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212b3a53-492b-40ee-acb0-b9cac161be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed52c7ed-6dae-45c8-bb09-2180ea3debd4', 'volume_name': 'volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1745e930-d619-4cb5-ac97-f92859540db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1745e930-d619-4cb5-ac97-f92859540db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18894e3-0cf0-4dc8-ba9b-3312849e390b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Volume ed52c7ed-6dae-45c8-bb09-2180ea3debd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4', 'volume_size': 1} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:06 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info Nov 02 11:05:06 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:06 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:06 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info is being set with open permissions: ugo+rw Nov 02 11:05:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:06 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info Nov 02 11:05:06 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:07 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.info" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1302284233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52c7ed-6dae-45c8-bb09-2180ea3debd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25874e4e2b414870baee6808787cdf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:07Z,use_quota=True,user_id='4f4acb3c6aa347e98bc8f0da8c5f542a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Creating volume ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:05:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:07 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 1073741824 Nov 02 11:05:07 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fc84b3ef-bec2-4aa6-a774-c9bc8cb2cc54 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:05:07 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 1073741824" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:07 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:07 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:07 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18894e3-0cf0-4dc8-ba9b-3312849e390b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b041f89-e3c8-4e6e-98c1-97228a1f3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Volume volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 (ed52c7ed-6dae-45c8-bb09-2180ea3debd4): created successfully Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b041f89-e3c8-4e6e-98c1-97228a1f3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Flow 'volume_create_manager' (79f782a5-5606-4243-9cde-bfff56718f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-183a02e6-811f-42d2-83a8-5b15640b0979 tempest-SnapshotDependencyTests-152858749 None] Created volume successfully. Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-f7c1f347-2696-425a-8ef1-6a7e68d47a69-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-f7c1f347-2696-425a-8ef1-6a7e68d47a69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-f7c1f347-2696-425a-8ef1-6a7e68d47a69" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-f7c1f347-2696-425a-8ef1-6a7e68d47a69" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot f7c1f347-2696-425a-8ef1-6a7e68d47a69 of volume 2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e109f-53ab-46a4-8d96-596fc95a69e6]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:08 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 Nov 02 11:05:08 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:08 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f92c263-8b94-4adc-b353-c3c1bf00e258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[941dd854-ab06-4617-ba80-82c63e6ad13d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:08 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 Nov 02 11:05:08 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Creating offline snapshot f74af73a-db7b-4dae-a81f-5c2580dddb6d of volume ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51179f-9b51-42b7-aa50-2ee34a34cde4]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 Nov 02 11:05:09 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:09 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d 1G Nov 02 11:05:09 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69 Nov 02 11:05:09 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258.f7c1f347-2696-425a-8ef1-6a7e68d47a69" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:09 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-f7c1f347-2696-425a-8ef1-6a7e68d47a69" released by "_delete_snapshot" :: held 1.448s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" released by "delete_snapshot" :: held 1.471s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Created reservations ['de1972e8-2892-4660-bc7b-8a2b9d026a0e', 'e02fc6c4-ccc1-4cc0-b1ca-46d53ea7b550', '7c20359d-e813-4032-8dc8-db0cb8273a7c', 'e2d05174-3a50-4b73-8009-f0909969a7fc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:09 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d 1G" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:05:09 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8a2a54d-7641-4e88-979a-cf596543c162 tempest-ProjectMemberTests-312285986 None] Lock "cinder-f7c1f347-2696-425a-8ef1-6a7e68d47a69-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:09 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 11:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-12b92d4a-26fc-4e88-beb0-1213f5d191c5 None None] thread info: [<_MainThread(MainThread, started 140665236017280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 11:05:10 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:10 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d is being set with open permissions: ugo+rw Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:10 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:10 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-2f92c263-8b94-4adc-b353-c3c1bf00e258-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:10 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "cinder-2f92c263-8b94-4adc-b353-c3c1bf00e258-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:10 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info Nov 02 11:05:10 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bc1076-e2ba-4307-83a5-f4ef035b8703]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:10 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 Nov 02 11:05:10 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:10 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:10 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info is being set with open permissions: ugo+rw Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:10 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info Nov 02 11:05:10 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:10 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258" returned: 0 in 0.430s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:10 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258 Nov 02 11:05:10 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:10 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.info" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-61e2405e-4a4c-4180-a235-cfd71eb5dda1 tempest-SnapshotDependencyTests-152858749 None] Create snapshot completed successfully Nov 02 11:05:11 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-2f92c263-8b94-4adc-b353-c3c1bf00e258" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-2f92c263-8b94-4adc-b353-c3c1bf00e258" released by "delete_volume" :: held 0.764s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Created reservations ['3c8a7801-002c-4e6a-8659-51944c58a723', 'bc223f46-f864-4b9e-910f-dc0e80265343', '253b9b61-b5ad-4c9d-b503-fb6d70abe527', '159e102a-e130-46fe-ab8f-5deb40c9a810'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:11 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:11 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:11 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a5e93cf3-aa6f-4316-a8b6-49cbc408f2aa tempest-ProjectMemberTests-312285986 None] Lock "cinder-2f92c263-8b94-4adc-b353-c3c1bf00e258-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (65de5edb-a6f4-4538-ad9b-12ae46141b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8781e5e-b7b9-427f-99d2-67110eaef7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8781e5e-b7b9-427f-99d2-67110eaef7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652748603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3888c4ae-97cd-4d36-8ec9-4b245d197bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:12Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8882452-00cd-4bcb-9404-8ca66f153890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8882452-00cd-4bcb-9404-8ca66f153890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d234baba-e67f-4b0d-80bf-f08e4bb20dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d234baba-e67f-4b0d-80bf-f08e4bb20dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3888c4ae-97cd-4d36-8ec9-4b245d197bb3', 'volume_name': 'volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a504e32b-414a-41c6-a35d-7066c89b43a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a504e32b-414a-41c6-a35d-7066c89b43a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f670e6-de9a-42fe-8435-6bc140677e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Volume 3888c4ae-97cd-4d36-8ec9-4b245d197bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3', 'volume_size': 1} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1652748603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3888c4ae-97cd-4d36-8ec9-4b245d197bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823e3054bead467c9e7369d948e5065b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:12Z,use_quota=True,user_id='0b52a3571a60489f866f27ad16741d7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Creating volume 3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:05:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] casted to osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 Nov 02 11:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:12 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 1073741824 Nov 02 11:05:12 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:12 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 1073741824" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:12 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 Nov 02 11:05:12 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Flow 'volume_create_manager' (7f01f81c-bbce-4090-b440-bf92db9062c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eca8e9-5a56-43ac-950e-80540a0ecf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85eca8e9-5a56-43ac-950e-80540a0ecf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T10:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff5134d-a1b4-48dd-9082-15ca7d6700b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25874e4e2b414870baee6808787cdf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T10:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f74af73a-db7b-4dae-a81f-5c2580dddb6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T10:05:13Z,use_quota=True,user_id='4f4acb3c6aa347e98bc8f0da8c5f542a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd7f3043-7953-44ba-90b5-56186d3c6096),volume_type_id=dd7f3043-7953-44ba-90b5-56186d3c6096)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1c298-a7b7-4175-8538-913f944f16e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d1c298-a7b7-4175-8538-913f944f16e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8284e1-e4cf-4312-a139-14f5b385ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8284e1-e4cf-4312-a139-14f5b385ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ff5134d-a1b4-48dd-9082-15ca7d6700b2', 'volume_name': 'volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2', 'volume_size': 1, 'snapshot_id': 'f74af73a-db7b-4dae-a81f-5c2580dddb6d'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa10e0ec-7ba7-43ee-8e38-3c32369fff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa10e0ec-7ba7-43ee-8e38-3c32369fff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e7b68-1981-4c68-9a9f-cc9e25fc8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Volume 5ff5134d-a1b4-48dd-9082-15ca7d6700b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2', 'volume_size': 1, 'snapshot_id': 'f74af73a-db7b-4dae-a81f-5c2580dddb6d'} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f670e6-de9a-42fe-8435-6bc140677e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cb2de9-042e-4421-8dbc-4cf1cc9466a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Creating volume 5ff5134d-a1b4-48dd-9082-15ca7d6700b2 from snapshot f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Selected osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Volume volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 (3888c4ae-97cd-4d36-8ec9-4b245d197bb3): created successfully Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cb2de9-042e-4421-8dbc-4cf1cc9466a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Flow 'volume_create_manager' (65de5edb-a6f4-4538-ad9b-12ae46141b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] snapshot: f74af73a-db7b-4dae-a81f-5c2580dddb6d, volume: 5ff5134d-a1b4-48dd-9082-15ca7d6700b2, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7c95bd43-8940-4049-96a3-157c7b9c432f tempest-ProjectMemberTests-312285986 None] Created volume successfully. Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c39f33c-41ff-4972-b4cd-b96c25c511b0]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:13 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:13 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:13 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c859b-be38-45dc-8d6b-526cfdd77b73]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:13 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:13 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:13 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Path /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 02 11:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:13 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 Nov 02 11:05:13 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:19 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" returned: 0 in 5.934s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 02 11:05:19 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Converted 1024.00 MB image at 172.53 MB/s Nov 02 11:05:19 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 is being set with open permissions: ugo+rw Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:19 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 Nov 02 11:05:19 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:19 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" released by "_copy_volume_from_snapshot" :: held 6.971s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" released by "_create_volume_from_snapshot" :: held 7.055s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.080s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.619s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Creating offline snapshot 9d023cbe-a9fc-49a9-bb9d-c637b8f79484 of volume 3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e7b68-1981-4c68-9a9f-cc9e25fc8053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2', 'volume_size': 1, 'snapshot_id': 'f74af73a-db7b-4dae-a81f-5c2580dddb6d'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a19148-772c-4934-a8e5-ac1127e998f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[af715098-2f4a-473f-bc2f-97253798e48d]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Volume volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 (5ff5134d-a1b4-48dd-9082-15ca7d6700b2): created successfully Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a19148-772c-4934-a8e5-ac1127e998f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 11:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Flow 'volume_create_manager' (7f01f81c-bbce-4090-b440-bf92db9062c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 11:05:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1dca5edd-6180-42be-981c-22f3cbce3394 tempest-SnapshotDependencyTests-152858749 None] Created volume successfully. Nov 02 11:05:19 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 Nov 02 11:05:19 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:20 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-f74af73a-db7b-4dae-a81f-5c2580dddb6d-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-f74af73a-db7b-4dae-a81f-5c2580dddb6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:20 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 1G Nov 02 11:05:20 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Deleting offline snapshot f74af73a-db7b-4dae-a81f-5c2580dddb6d of volume ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] snapshot_file for this snap is: volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6d751-85bb-47d6-b764-7db9f11ce23b]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:20 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:20 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:20 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 1G" returned: 0 in 0.410s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:20 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 Nov 02 11:05:20 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:20 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a075030-abb0-4c32-a3a3-d30c315cb1d2]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:20 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:20 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:20 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 -F qcow2 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:20 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 is being set with open permissions: ugo+rw Nov 02 11:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:21 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 Nov 02 11:05:21 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:21 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:21 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info Nov 02 11:05:21 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:21 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.568s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:21 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:21 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:21 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info is being set with open permissions: ugo+rw Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:21 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info Nov 02 11:05:21 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:21 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:21 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d Nov 02 11:05:21 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:21 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.info" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5189ba42-67a7-4437-a6fb-0670d40167f2 tempest-ProjectMemberTests-312285986 None] Create snapshot completed successfully Nov 02 11:05:21 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4.f74af73a-db7b-4dae-a81f-5c2580dddb6d" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-f74af73a-db7b-4dae-a81f-5c2580dddb6d" released by "_delete_snapshot" :: held 1.634s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" released by "delete_snapshot" :: held 1.660s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Created reservations ['1c2bf0c1-55bd-4351-9e8f-1cdb7fa4ab35', '6c4a1788-23a4-42b3-ab77-6b48023cd9cd', '829ae035-8f6b-48d1-bbfa-2a1ac17d46f3', '0c20994a-f57e-4371-9a40-bfd7d3b3e94e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Delete snapshot completed successfully. Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8cbdb311-67a3-44b7-9048-83e946af8f45 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-f74af73a-db7b-4dae-a81f-5c2580dddb6d-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-ed52c7ed-6dae-45c8-bb09-2180ea3debd4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-ed52c7ed-6dae-45c8-bb09-2180ea3debd4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ebc6a2-7d0f-4c37-bdcd-e0c28bdee771]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-9d023cbe-a9fc-49a9-bb9d-c637b8f79484-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-9d023cbe-a9fc-49a9-bb9d-c637b8f79484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-9d023cbe-a9fc-49a9-bb9d-c637b8f79484" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-9d023cbe-a9fc-49a9-bb9d-c637b8f79484" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Deleting offline snapshot 9d023cbe-a9fc-49a9-bb9d-c637b8f79484 of volume 3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] snapshot_file for this snap is: volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b9be94-671f-472d-9c59-6fbf4273ce23]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:22 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.380s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4 Nov 02 11:05:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:22 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 Nov 02 11:05:22 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:23 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-ed52c7ed-6dae-45c8-bb09-2180ea3debd4" released by "delete_volume" :: held 0.686s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:23 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484" returned: 0 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Created reservations ['69b032e2-8059-46c0-a8c3-37c4c2de616d', '4ee1de45-84df-4791-acf8-018588d5361b', '8bfc498c-e895-4f2a-b42b-658f4d0220c3', 'ca06d877-dcd5-4695-bad2-0741b9735784'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2166c-5288-4b90-b374-0519d8c66879]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:23 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:23 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:23 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 Nov 02 11:05:23 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:23 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-5ff5134d-a1b4-48dd-9082-15ca7d6700b2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Deleted volume successfully. Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-5ff5134d-a1b4-48dd-9082-15ca7d6700b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8754efda-f405-4e2e-8512-1189843d0722 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-ed52c7ed-6dae-45c8-bb09-2180ea3debd4-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:23 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:23 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 Nov 02 11:05:23 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6200b-1532-4c50-8345-15a83b462a74]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:23 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 Nov 02 11:05:23 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:24 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:24 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484 Nov 02 11:05:24 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:24 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:24 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2 Nov 02 11:05:24 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:24 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3.9d023cbe-a9fc-49a9-bb9d-c637b8f79484" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-9d023cbe-a9fc-49a9-bb9d-c637b8f79484" released by "_delete_snapshot" :: held 1.527s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" released by "delete_snapshot" :: held 1.553s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:24 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Created reservations ['aa7a5e29-e4fe-4bed-ab4f-9c0caea1c052', '095bbb30-18f3-4826-ad8a-c8ced8aaf033', '25a31f2f-1358-4a58-9cd7-38728e3c4cde', '9e841118-0f24-4ff4-99bc-79b5536d3a52'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-quobyte-5ff5134d-a1b4-48dd-9082-15ca7d6700b2" released by "delete_volume" :: held 0.699s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Delete snapshot completed successfully. Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3d33dc21-57ae-4fd1-907e-2c6b92a51ffe tempest-ProjectMemberTests-312285986 None] Lock "cinder-9d023cbe-a9fc-49a9-bb9d-c637b8f79484-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Created reservations ['b3b0e488-3b18-40d3-878e-66996aae0a0c', 'd2455803-f0b9-44b1-b307-206b25295617', 'db49c41a-f3a4-4c4f-b8e1-6e2a5e759e98', '0f4141c1-20b2-4aa1-bb72-fabc467b1bd0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:24 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:24 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:24 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Deleted volume successfully. Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-39736b9b-b478-4d1d-98e5-7523e41cd7f0 tempest-SnapshotDependencyTests-152858749 None] Lock "cinder-5ff5134d-a1b4-48dd-9082-15ca7d6700b2-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-3888c4ae-97cd-4d36-8ec9-4b245d197bb3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "cinder-3888c4ae-97cd-4d36-8ec9-4b245d197bb3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Acquiring lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 11:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0a8c6-70d7-40ab-a0c5-7dc6eb78e0db]: (4, 'qcow2') {{(pid=88459) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:25 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 Nov 02 11:05:25 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:25 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" returned: 0 in 0.341s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:25 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3 Nov 02 11:05:25 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:25 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be/volume-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "cinder-quobyte-3888c4ae-97cd-4d36-8ec9-4b245d197bb3" released by "delete_volume" :: held 0.712s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Created reservations ['b194d2dc-fd69-443c-8706-df88b5ca730b', '60dc2b77-9f9c-4f03-89c8-b64923264354', '96296127-dfab-4133-beb9-f2f85e10c961', '4cc16af8-a25c-423f-bcf8-088cbb2fb9de'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e774f64-3bb2-4123-81ef-1d4d2fcc6149'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 11:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 11:05:25 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be Nov 02 11:05:25 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 11:05:26 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 02 11:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1545e8506086f06ae517ba5c133e1be" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 11:05:26 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 11:05:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Deleted volume successfully. Nov 02 11:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ff296bb0-de81-4091-b7e2-c5661bceca04 tempest-ProjectMemberTests-312285986 None] Lock "cinder-3888c4ae-97cd-4d36-8ec9-4b245d197bb3-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 11:05:35 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=81,cinder:UPDATE=99,cinder:INSERT=25,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 11:05:36 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=75,cinder:UPDATE=96,cinder:DELETE=8,cinder:INSERT=29 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}